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ABSTRACT 



A background discriminating unit for discriminating the 
state of background of an input image. An adaptive quantizer 
quantizes the input image based upon the state of the 
background to form a bi-level image of the background. An 
area partitioning unit partitions the input image into areas 
based upon the bi-level image of the background. Each area 
resulting from partitioning is coded by a multivalued image 
coder or bi-level image coder in dependence upon the 
characteristic of the area. Accordingly, an input image can be 
partitioned into areas correctly based upon the characteris- 
tics of the area and the areas obtained by partitioning can be 
coded in conformity with the characteristic of the area. 

34 Claims, 33 Drawing Sheets 
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IMAGE PROCESSING APPARATUS AND 
METHOD 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates to an image processing method and 
apparatus. For example, the invention relates to an image 
processing apparatus method for coding an image upon 
dividing the image into areas, and an image processing 
apparatus and method for recognizing a background area 
from image data. 

2. Description of the Related Art 

The rapid progress that has been made in image coding 
techniques in recent years has been accompanied by 
progress in international standardization. The JPEG (Joint 
Photographic Experts Group) scheme has been adopted as 
the standard for non-reversible coding of multivalued color 
images, and the JBIG (Joint Bi-level Image Group) scheme 
has been adopted as the standard for reversible coding of 
monochromatic bi-level images. The standardization of new 
coding methods is proceeding. 

FIG. 1 is a block diagram showing the architecture of an 
image coding apparatus. The apparatus includes a scanner 

1001 for entering an image, a selector 1002 for selecting the 
destination of the input image in accordance with a com- 
mand entered by the user, a JPEG coder 1003 for coding the 
input image according to the JPEG standard, a binarizer 
1004 for binarizing the input image, a JBIG coder 1005 for 
coding the bi-level image from the binarizer 1004, a selector 
1006 for selecting the source of an input code in accordance 
with a command entered by the user, a communication 
interface 1007 and a communication line 1008 such as a 
telephone line or LAN. It should be noted that the selectors 

1002 and 1006 operate in synchronism so that the image 
coded via the selector 1002 will be sent to the communica- 
tion interface 1007 via the selector 1006. 

When the user wishes to transmit a color image using this 
apparatus, the JPEG coder 1003 is selected as the destination 
of the output from the selector 1002 and as the source of the 
input to the selector 1006. Next, the scanner 1001 is operated 
to enter the image data, and the image data are entered into 
the JPEG coder 1003 via the selector 1002, whereby code 
data coded according to the JPEG standard are obtained. 
These code data are entered into the communication inter- 
face 1007 via the selector 1006, after which the data are sent 
to the communication line 1008 by the communication 
interface 1007 in accordance with a predetermined protocol. 

When the user wishes to transmit a monochromatic 
bi-level image using this apparatus, the binarizer 1004 is 
selected as the destination of the output from the selector 
1002 and the JBIG coder 1005 is selected as the source of 
the input to the selector 1006. Next, the scanner 1001 is 
operated to enter the image data, and the image data are 
entered into the binarizer 1004 via the selector 1002. The 
binarizer 1004 compares the entered image data with a 
preset threshold value to binarize the image data. The 
binarized image data enter the JBIG coder 1005, whereby 
the data are converted to code data in accordance with the 
JBIG standard. These code data are entered into the com- 
munication interface 1007 via the selector 1006, after which 
the data are sent to the communication line 1008 by the 
communication interface 1007 in accordance with a prede- 
termined protocol. 

However, the technique described above has certain short- 
comings. Specifically, in the above-described image coding 
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apparatus in which the coding method is changed:over on an -utah^ i . 
image-by-image basis, characters and line-image portions 
contained in an image are subjected to multivalued coding as 
by the JPEG scheme. As a consequence, edges, which are 

5 the characterizing features of a character or line drawing, 
become blurred. This results in a decline in the quality of the 
appearance of the characters and line drawings. Further, 
when bi-level binarization is performed according to the 
JBIG standard, grayscale portions contained in the image are 

10 flattened by binarization. 

According to a proposed improvement in the JPEG 
standard, the features of an image are judged on a coding 
unit basis (i.e., in blocks of 8x8 pixels) and either the 
quantization coefficient or the coding table is changed over 

1S (see U.S. application Ser. No. 736,740, filed on Jul. 26, 
1991). With this method, however, referential pixels for 
judging the features of an image are too few to obtain correct 
results. 

It has also been contemplated to change over the coding 

20 scheme upon judging image areas in large zones using a 
method of binarizing a multivalued image to separate the 
image into areas such as character/line-image areas and 
photographic areas (see U.S. application Ser. No. 524,409, 
filed on Sep. 6, 1995). However, with a method of extracting 

25 image areas whose density is greater than a predetermined 
density using a fixed or variable threshold value, it is not 
possible to accommodate low-contrast characters and line 
drawings or outline characters. 

3Q Furthermore, when a multivalued image is binarized and 
the edge of a character or line drawing is indistinct at the 
start, the binarized image develops thickening that can cause 
judgment errors when the image is-separated into areas. In 
particular, when there is no longer white space between 

3S characters and a character area is erroneously judged to be 
a grayscale area, character/line-drawing areas undergo mul- 
tivalued coding. This problem is similar to that encountered 
with the image coding apparatus, which changes over the 
coding method on an image-by-image basis. 

Recent progress in the development of image processing 
apparatus has been accompanied by proposals relating to'an " 
image processing apparatus having an image-area partition- 
ing function according to which a multivalued image con- 
taining character areas and pattern areas is divided into areas 

45 conforming to the features of the areas and the coding 
method is changed over area by area to improve the effi- 
ciency of coding, or according to which areas containing 
characters are extracted and the characters are read optically 
(generally referred to as "OCR"). 

50 As described in the specifications of Japanese Patent 
Application Laid-Open No. 62-226770 (entitled "Image 
Area Discriminating Apparatus") and Japanese Patent 
Application Laid-Open No. 3-126181 (entitled "Method of 
Partitioning Document Image into Areas"), for example, 

55 image processing apparatus which execute image-area par- 
titioning processing are mostly apparatus which binarize a 
multivalued image in dependence upon a predetermined 
threshold value and discriminate whether an area is a 
character area, photographic area or table, etc., based upon 

60 the bi-level image. Further, as described in the specification 
of Japanese Patent Application Laid-Open No. 4-248766 
(entided "Image Area Separation"), for example, a method 
has been proposed in which an image is separated into 
character areas and pattern areas using background as a 

65 "white** area. 

Further, the recent rapid popularity of DTP has been 
accompanied by increasing diversification of documents and 
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u other-images, and methods of -perforating areapartitioningv, > -reference characters designate c the. < same or. sirnilar-tparts.^u^.'ii^iiti:: 

processing are not limited to that mentioned above but are throughout the figures thereof, 
themselves becoming increasingly diverse. 

However, processing for partitioning image areas in the 

above-described image processing apparatus largely entails 5 pjQ y ^ a block diagram illustrating the architecture of 

subjecting a multivalued image to binarization processing. an image coding apparatus; 

When such binarization processing is executed, the entire F1(J 2 fc a Mock df illustrati the architecture of 
image is binanzed at a fixed threshold value without taking an . ^ apparatus having equipped with the image 
the density of the image background into consideration. processing acc0 rding to this embodiment of the invention; 
Depending upon the background color, therefore, appropn- 10 m „ , , . e 
ate binarization is not always carried out and the results of u 3 " ^ block diagram showing the architecture of a 
area partitioning can develop an error. This means that it is background discriminator depicted in FIG. 2; 
not possible to deal suitably with a document printed on FIG 4 K a diagram for describing a method of extracting 
paper whose background is colored or exhibits a density a density width having the maximum frequency of occur- 
other than white. is rence; 

The fact that the above-described processing for parti- FIG. 5 is a block diagram showing the architecture of an 

tioning image areas binarizes the entire image at a single adaptive quantizer depicted in FIG. 2; 

threshold value leads to other problems as well. For FIG. 6 is a block diagram illustrating the architecture of 

example, when each cell in a table is given meaning as by an image coding apparatus having equipped with the image 

changing its density or color, or when the ruled lines of a 20 processing according to a second embodiment of the inven- 

table are deleted as by changing the density or color of rows tion; 

or columns, the differences in density or color are ignored, FIG 7 is a block diagram showing the architecture of a 

the cells of the table can no longer be recognized. background discriminator depicted in FIG. 6; 

Though a technique for separating the background portion 25 P IGS. 8A and 8B are diagrams for describing a method-of 
from a color image has been proposed in the specification of extracting a density width having the maximum frequency 
U.S. application Ser. No. 08/579,358, filed on Dec. 27, 1995, 0 f occurrence- 
there is still room for improvement. piG p ^ a ^ showmg (he architecture of aa 

SUMMARY OF THE INVENTION adaptive quantizer depicted in FIG. 6; 

A j • i „ ( < 4 * . . 30 FIG. 10 is a block diagram showing the architecture of a 

Accordingly, an object of the present mvention is to ... . . , , " 4 , . „ T _ & r 

•j ■ • A. j j c bi-level image coder depicted m FIG. 6; 
provide an image processing method and apparatus for 

correctly dividing an input image into areas based upon the F1G - 11 15 a bIock diagram illustrating the architecture of 

characteristics of the image and subjecting each resulting an ma S e codm g apparatus having equipped with the image 

area to coding conforming to the particular characteristic. 35 processing according to a third embodiment of the inven- 

According to a preferred embodiment of the present tlon ' 

invention, the foregoing object is attained by providing an FIGS - 12 trough 15 are flowcharts showing coding 

image processing apparatus comprising discriminating processing according to the third embodiment; 

means for discriminating state of background of an input FIGS. 16A through 16D are diagrams showing examples 

image, quantizing means for quantizing the input image ^ °f me contents of area information tables; 

based upon results of discrimination from the discriminating ■ ■ FIG. 17 is a block diagram showing the architecture' of an 

means, partitioning means for partitioning the input image adaptive quantizer according to a fourth embodiment of the 

into areas based upon results of quantization from the present invention; 

quantizing means, and coding means for coding each par- FIG. 18 is a block diagram showing the architecture of an 

titioned area in conformity with characteristics of the area. 4S adaptive quantizer according to a fifth embodiment of the 

Another object of the present invention is to provide an present invention; 

image processing method and apparatus in which back- FIG. 19 is a sectional view showing the internal structure 

ground information of the entire image and small back- Q f a laser-beam printer according to a sixth embodiment of 

ground areas constructing sub-areas can each be extracted the present invention; 

appropriately. 50 pIG. 20 is a block diagram showing an arrangement for 

According to a preferred embodiment of the present executing background recognition processing according to 

invention, the foregoing object is attained by providing an this embodiment; 

image processing apparatus for detecting background infor- FIG. 21 is a flowchart showing background recognition 

mation from image data, comprising flatness extracting processing according to this embodiment; 

means for extracting a flat pixel forming flatness from the ss FIG. 22 is a block diagram showing the detailed archi- 

unage data, background extracting means for ^extracting Qf a ^ ^ ^ ^ in mQ 

background information from the image data based upon ^ / ° . , . 

information of the flat pixel, pixel-value extracting means FIGS - BA ihTOU & 230 m diagrams showing typical 

for extracting a principal pixel value, which constitutes the examples of frequency distributions of pixel values; 

image data, as a representative-pixel value based upon the 60 FIG * 24 15 a block diagram showing the detailed archi- 

information of the flat pixel, and background-area extracting tecture of a background extracting unit depicted in FIG. 20; 

means for extracting information of a partial background FIG. 25 is a block diagram showing the detailed archi- 

area contained in the image data based upon a distribution of tecture of a representative-pixel extracting unit depicted in 

extracted representative-pixel values. FIG. 20; 

Other features and advantages of the present invention 65 FIG. 26 is a block diagram showing the detailed archi- 

will be apparent from the following description taken in tecture of a sub-background area extracting unit depicted in 

conjunction with the accompanying drawings, in which like FIG. 20; 
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rKt^FICi 27t is^diagranrfor: describing processing, executed .v.v sively* reading ca .pixel ofvinteresband its-neighboring*, pixels^ 

by the sub-background area extracting unit depicted in FIG. out of the frame memory 21 and, when the pixel of interest 

26; is a pixel forming a flat portion of the image, for outputting 

FIG. 28 is a block diagram showing an arrangement for the value of this pixel. Known methods used by the flat-pixel 

executing background recognition processing in an image 5 extracting unit 22 to determine whether a pixel is a flat pixel 

processor according to a seventh embodiment of the inven- include a method of extracting maximum and minimum 

uon ; values and a method disclosed by Tetsutani and Koshiji in 

FIG. 29 is a block diagram showing the detailed archi- " Method °f Binarizmg a Document of Mixed Bi-leyel 

lecture of a flat-pixel extracting unit depicted in FIG. 28; ^f 5 V 16 ^^ ™f S ' De n mhl GMai 

_ „ rt . ^ , . * . j *ij , • 10 Ronbunshi, 1984/7 Vol. J67-B, No. 7, pp. 781-788. 

FIG. 30 is a block diagram showing .the detailed archi- A frequency counter 23 is composed of 25 6 counters, each 

lecture of a background extracting unit depicted in FIG. 28; of whjch corresponds t0 ^ mput value . ^ m}mUx lnat 

FIG. 31 is a block diagram showing the detailed archi- corresponds to the pixel value outputted by the flat-pixel 

lecture of representative-pixel extracting unit depicted in extracting unit 22 is counted up. A maximum-frequency 

FIG. 28; and !5 extracting unit 24 outputs a value (0-255) that corresponds 

FIG. 32 is a block diagram showing an arrangement for to the counter exhibiting the maximum count (frequency) 

executing background recognition processing in an image among the counters constructing the frequency counter 23. 

processor according to the eighth embodiment of the inven- Numeral 25 denotes a unit for extracting a density width 

tion. having the maximum frequency of occurrence. Specifically, 

20 let hist[i] (i-0-255) represent the count of each counter in 
DESCRIPTION OF THE PREFERRED me frequency counter 23, and let b represent the value 
EMBODIMENTS (referred to as a "background-candidate value" below) out- 
Embodiments of the present invention will now be P utted b Y the maximum-frequency extracting unit 24. The 
described in detail with reference to the drawings. unit 25 obtains a pixel value btl (upper-limit value of the 

25 background candidate) and a pixel value btO (lower-limit 
First Embodiment value of the background candidate) which, as shown in FIG. 
[Architecture] 4, are values in the vicinity of the background-candidate 
FIG. 2 is a block diagram illustrating an example in which value b that have a density less than a preset threshold value 
an image processor according to the first embodiment of the Thl and are closest to the background -candidate value b. It 
invention is applied to an image transmitting apparatus. 30 should be noted that the lower-limit value btO of the back- 
As shown in FIG. 2, the apparatus includes a CPU 3 for ground candidate and the upper- limit value btl of the 
controlling the overall apparatus via a bus 4 in accordance background candidate can be obtained from the points of 
with a program stored in a ROM 3a or storage unit 2, etc. intersection between the straight line at the level of threshold 
The RAM 3b serves as the working memory of the CPU 3 value Thl and the frequency curve in the vicinity of the 
and is used to exchange image data and control signals via 35 background-candidate value b. 

the bus 4. A subtracter 37 obtains the difference (background den- 

The apparatus further includes a scanner 1 for entering an sity width) w between the lower-limit value btO of the 

image, a background discriminator 5 for judging the state of background candidate and the upper-limit value btl of the 

background in the input image and outputting information background candidate. A background-occupancy calculating 

indicative of the background, an adaptive quantizer 6 for 40 unit 26 divides the sum of the counts from the frequency 

adaptively quantizing the input image, an area separator 7 counters 23 corresponding to the pixel values bracketed by 

which, on the basis of results of quantization, separates the the lower-limit value btO of the background candidate and 

input image into areas whose image characteristics resemble upper-limit value btl of the background candidate, by the 

one another, an area memory 14 for storing the results of number of pixels in the overall image, thereby obtaining the 

area separation outputted by the area separator 7, an area 45 occupancy s of the background. A comparator 27 compares 

information coder 8 for coding the results of area separation, the background density width w with a threshold value Th2, 

a multivalued image coder 9 for coding a multivalued image and a comparator 28 compares the background occupancy s 

such as a photograph contained in the input image, a bi-level with a threshold value Th3. These comparators output "1" if 

image coder 10 for binarizing and coding a bi-level image the input value is greater than the threshold value and "0" 

such as a character or line drawing contained in the input 50 otherwise. An inverter 29 inverts the output of the compara- 

image, a synthesizer U for combining and outputting code tor 27, and an AND gate 30 takes the logical product 

data outputted by each of the coders, a communication between the output of inverter 29 and the output of com- 

interface (IF) 12 and a communication line 13 such as a . parator 28. 

telephone line or LAN. The operation of the background discriminator 5 will now 

It will be assumed in the description below that the input 55 be described, 

image is a monochromatic multivalued (grayscale) image of Before processing starts, the CPU 3 clears the frame 

eight bits per pixel, that the coding method used by the memory 21 and the frequency counter 23. Next, in accor- 

multivalued image coder 9 is the JPEG coding method, and dance with a command from the user, a monochromatic 

that the coding method used by the bi-level image coder 10 multivalued image read in from the scanner 1 or storage unit 

is the JBIG coding method. However, the present invention 60 2 is stored in the frame memory 21. When one frame of an 

is not limited to such an arrangement. image has been stored in the frame memory 21, the flat-pixel 

[Background Discriminator] extracting unit 22 reads a pixel of interest and its eight 

FIG. 3 is a block diagram showing the architecture of the surrounding pixels (referential pixels) out of the frame 

background discriminator 5. memory 21 in succession, obtains the maximum difference 

As shown in FIG. 3, the background discriminator 5 65 between the value of the pixel of interest and each of the 

includes a frame memory 21 for storing one frame of entered referential pixels and, if the value of this difference is less 

image data, and a flat-pixel extracting unit 22 for succes- than a threshold value Th4, outputs the pixel of interest as a 
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counts up the counter corresponding to the outputted pixel background). The area separator 7 reads out the data stored 

value. in the frame memory 52, extracts a rectangular area which, 

When processing for extracting the flat pixel ends with based upon the feature of the image, is a character area, 

regard to all pixels of the image stored in the frame memory 5 photographic area, line-drawing area or separator, and out- 

21, the maximum-frequency extracting unit 24 outputs the puts area information which includes the positional coordi- 

value (the background-candidate value b) corresponding to nates of the area (e.g., the xy coordinates of the upper-left 

the counter having the maximum count among the counters corner of the rectangular area), the size of the rectangular 

in frequency counter 23. Next, the density -width extracting area and a code representing the result of area discrimina- 

unit 25 obtains the lower-limit value btO of the background 10 tion. This area information is stored in the area memory 14. 

candidate and the upper- limit value btl of the background When the background discrimination flag bg is "0" 

candidate from the counts recorded by the frequency counter (patterned background), the CPU 3 does not actuate the area 

23. The subtractor 37 obtains the background density width separator 7 and stores area information, in the area memory 

w from the lower-limit value btO of the background candi- 14, that includes (x,y)=(0,0) (origin) as the positional coor- 

date and the upper-limit value btl of the background can- 15 dinates of the rectangular area, the size of the overall image 

didate that have been obtained, and the background density as the size of the rectangular area and the code of the 

width w is compared with the threshold value Th2 by the photographic area as the code representing the result of area 

comparator 27. discrimination. In other words, area separation is not carried 

The background-occupancy calculating unit 26 obtains out with regard to an image whose background has a pattern, 

the background occupancy s from the lower-limit value btO 20 Examples of methods of separating an image into areas 

of the background candidate and the upper- limit value btl of are a method, described in Japanese Patent Application 

the background candidate, and the background occupancy s Laid-Open Mo. 62-226770 entitled "Image Area Discrimi- 

is compared with the threshold value Th3 by the comparator nating Apparatus" and Japanese Patent Application Laid- 

28. Open Ho. 3-126181 entitled "Method of Partitioning Docu- 

TTie output of the comparator 27 is inverted by the inverter 25 ment Image into Areas"), of binarizing an image at a 

29 and is applied to the AND gate 30 together with the threshold value and discriminating areas such as character 

output of the comparator 28. The AND gate 30 outputs a areas, photographic areas and tables from clusters of pixels, 

background m^rimination flag bg, which is the logical and a method, described in Japanese Patent Application 

product of two inputs. Laid-Open No. 4-248766 (entitled "Image Area 

When the background density width w is less than the 30 Separation"), of separating an image into characters and 

threshold value Th2 and the background occupancy s is pattern areas with background serving as a white area, 

greater than the threshold value Th3, the flag bg becomes [Transmission of Image Data] 

logical "l w , which represents solid (plain) background. When storage of the area information in the area memory 

When these conditions are not satisfied, the flag bg becomes 14 ends, the CPU 3 sends the background candidate value b 

logical "0", which represents background having a pattern. 35 to the communication line 13 via the synthesizer 11 and 

[Adaptive Quantizer] communication interface 12. 

FIG. 5 is a block diagram showing the architecture of the Next, the CPU 3 reads the area information out of the area 

adaptive quantizer 6. memory 14 successively, enters the read area information 

As shown in FIG. 5, a comparator 45 compares an entered into the area information coder 8 and sends the coded area 

pixel of interest D with the upper-limit value btl of the 40 information to the synthesizer 11. If the rectangular area 

background candidate provided by the background discrimi- represented by the area information is a photographic area, 

nator 5, outputs "1" if btl>D holds and "(T otherwise. A the image data of the area read out of the frame memory 21 

comparator 46 compares the entered pixel of interest D with of the background discriminator 5 are entered into the 

the lower-limit value btO of the background candidate pro- multivalued image coder 9 and the JPEG-coded image data 

vided by the background discriminator 5, outputs "1" if 45 are sent to me synthesizer 11. If the read area information is 

D>bt0 holds and "0" otherwise. The outputs of the com- indicative of a character area, line-drawing area or separator, 

parators 45 and 46 are applied to an AND gate 49. A frame the image data (represented by "0") of the area read out of 

memory 52 stores the output of the AND gate 49. the frame memory 52 of the adaptive quantizer 6 are entered 

The operation of the adaptive quantizer 6 will now be into the bi-level image coder 10 and the JBIG-coded data are 

described. 50 sent to the synthesizer 11. 

When processing by the background discriminator 5 ends, The synthesizer 11 combines the coded area information 

the CPU 3 reads pixels of interest out of the frame memory and the code data obtained by coding the image data of the 

21 of background discriminator 5 successively and applies rectangular area represented by the area information and 

them to the adaptive quantizer 6, whereupon the compara- sends the resulting signal to the communication line 13 via 

tors 45 and 46 perform the above-mentioned comparison 55. the communication interface 12. 

operations. The AND between the outputs of the two com- [Summary] 

parators 45, 46 is obtained by the AND gate 49. The output Thus, according to this embodiment, background is dis- 

of the AND gate 49 is "1" if the pixel of interest D is criminated based upon the frequency distribution of pixel 

between the upper-limit vahie btl of the background can- values in an input image to be coded, the background is 

didate and the lower-limit value btO of the background 60 extracted and it is determined whether the background is 

candidate and "0" otherwise. Accordingly, a bi-level image solid background or patterned background. If the back- 

whose background is represented by data "1" is stored in the ground of the input image is solid background, a bi-level 

frame memory 52. image is formed from the input image based upon the 

[Area Separator] density of the extracted background, areas such as character/ 

When the processing executed by the adaptive quantizer 65 line-drawing areas and photographic areas are separated 

6 ends for all pixels that have been stored in the frame from the bi-level image and image data in these separated 

memory 21, the CPU 3 actuates the area separator 7 when areas are coded using a coding method suited to the area. If 
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image is coded by multivalued-image coding without par- 
titioning the image into areas. In accordance with this 
embodiment, therefore, the following effects can be 
obtained; 5 

(1) Background is extracted from a distribution of pixel 
values. If the density of the background is low, therefore, it 
is possible to suppress the effects of "see-thru", in which 
matter on the reverse side of a document can be seen through 
the document. 10 

(2) A bi-level image is formed from the input image based 
upon the density of the extracted background, and the 
bi-level image is separated into areas. As a result, even 
low-contrast characters/line drawings and outline characters 
can be separated correctly. 15 

(3) The image data in an area are coded using the coding 
method suited to the area. As a result, edges that distinguish 
characters and line drawings are not made indistinct, the 
quality of characters is not sacrificed and flattening of 
grayscale portions is not brought about by binarization. 20 

(4) If background exhibits a pattern, the entire image is 
coded using multivalued-image coding. This means that 
optimum coding that takes the background pattern into 
account can be carried out. 

Thus, the method of extracting areas according to this 25 
embodiment of the invention makes it possible to discrimi- 
nate areas with a high degree of precision and to extract 
character/line -drawing areas even in images that have under- 
gone a negative/positive reversal. 



Second Embodiment 

An image processing apparatus according to a second 
embodiment of the present invention will now be described. 
Elements in the second embodiment identical with those of 
the first embodiment are designated by like reference char- 
acters and need not be described again. 
[Architecture] 

FIG. 6 is a block diagram illustrating an example in which 
an image processor according to the second embodiment of 
the invention is applied to an image transmitting apparatus. 
This embodiment differs from the first embodiment shown 
in FIG. 2 in that a multivalued image enters the bi-level 
image coder 10 along with the results of area separation and 
the bi-level image. 

It will be assumed in the description below that the input 
image is an RGB color multivalued image of eight bits per 
pixel for each of the colors R, G, B, that the coding method 
used by the multivalued image coder 9 is DPCM (differential 
pulse-code modulation) coding, and that the coding method 
used by the bi-level image coder 10 is MMR (modified 
modified READ) coding. However, the present invention is 
not limited to such an arrangement. 
[Background Discriminator] 

FIG. 7 is a block diagram showing the architecture of the 
background discriminator 7. 

As shown in FIG. 7, the background discriminator 5 
J includes a luminance generator 122 for converting entered 
1 RGB image data into a luminance signal L* in CIE1976 
I L*a*b* uniform color space, a frame memory 123 for 
V storing one frame of L* image data, a smoother 126 for 
reading in the image data from the frame memory 123 and 
performing 3x3 pixel smoothing, and a minimal-value cal- 
culating unit 124. As exemplified in FIGS. 8A, 8B, the 
minimal-value calculating unit 124 obtains.a pixel value bvl 
(second upper-limit value of a background candidate) and a 
pixel value bvO (second lower-limit value of a background 
candidate) which are values in the vicinity of the 
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;;background-candidate>value tb tmatvexhibiti;mmima.andv:arej t m« 
closest to the background -candidate value b. It should be 
noted that the outputs btO, btl from the density-width 
extracting unit 25 shall be referred to as first and second 
upper-limit values of the background candidate, respec- 
tively. 

The operation of the background discriminator 5 will now 
be described mainly with regard to the features that distin- 
guish it from that of the first embodiment. 

Before processing starts, the CPU 3 clears the frame 
memory 21 and the frequency counter 23. Next, in accor- 
dance with a command from the user, a color multivalued 
image read in from the scanner 1 or storage unit 2 is stored 
in the frame memory 21. When one frame of an image has 
been stored in the frame memory 21, the luminance gen- 
erator 122 reads the RGB image data out of the frame 
memory 21 in succession, makes the conversion to L* image 
data and writes these data in the frame memory 123. 

When one frame of the L* image data has been stored in 
the frame memory 123, the smoother 126 reads the pixel of 
interest and its surrounding pixels (for a total of 3x3 pixels) 
out of the frame memory 123 and smoothes the pixel of 
interest. The flat-pixel extracting unit 22 in this embodiment 
determines whether the pixel of interest is a pixel forming a 
flat portion based upon the smoothed pixel of interest and its 
eight surrounding referential pixels, and the number of flat 
pixels is counted by the frequency counter 23. 

Upon conclusion of smoothing processing, processing for 
extracting flat pixels and counting executed with regard to 
all pixels stored in the frame memory 123, the maximum- 
frequency extracting unit 24 outputs the background- 
candidate value b, the density-width extractingmiit 25 
outputs - tfie~Tu?Tlo we r-limit value btO of the background 
candidate and the first upper-limit value btl of the back- 
ground candidate, and the minimal- value calculating unit 
124 outputs the second lower-limit value bvO of the back- 
ground candidate and the second upper-limit value bvl of 
the background candidate. 
[Adaptive Quantizer] 

FIG. 9 is a block diagram showing the architecture of the 
adaptive quantizer 6. 

The adaptive quantizer 6 includes selectors 147 and 148 
for selecting and outputting inputs in accordance with the 
background discriminating flag bg. The selector 148 selects 
either the first or second lower-limit value of the background 
candidate and enters the selected lower-limit value of the 
background candidate into the comparator 46. The selector 
147 selects either the first or second upper-limit value of the 
background candidate and enters the selected upper-limit 
value of the background candidate into the selector com- 
parator 45. 

The operation of the adaptive quantizer 6 will now be 
described mainly with regard to the features that distinguish 
it from that of the first embodiment. 

When processing by the background discriminator 5 ends, 
the CPU 3 reads pixels of interest out of the frame memory 
21 of background discriminator 5 successively and applies 
them to the adaptive quantizer 6, whereupon the compara- 
tors 45 and 46 perform the above-mentioned comparison 
operations. The AND between the outputs of the two com- 
parators 45, 46 is obtained by the AND gate 49, whose 
output is written in the frame memory 52. 

When the background discrimination flag bg is "1" 
(which represents solid background), the selector 147 selects 
the first upper-limit value btl of the background candidate 
and the selector 148 selects the first lower-limit value btO of 
the background candidate. The operations of the compara- 
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s tors 45iand.46;areras described.-in the first.embodiment.rEhat.i. 
is, if the pixel of interest D is between the first upper-limit 
value btl of the background candidate and the first lower- 
limit value btO of the background candidate, the output of 
the AND gate 49 is "1"; otherwise, the output of the AND 
gate 49 is "0". 

When the background discrimination flag bg is "0" 
(which represents patterned background), the selector 147 
selects the second upper-limit value bvl of the background 
candidate and the selector 148 selects the second lower- limit 
value bvO of the background candidate. Accordingly, if the 
pixel of interest D is between the second upper-limit value 
bvl of the background candidate and the second lower-limit 
value bvO of the background candidate, the output of the 
AND gate 49 is "1"; otherwise, the output of the AND gate 
49 is "0". 

Accordingly, a bi-level image whose background is rep- 
resented by data "1" is stored in the frame memory 52. Id 
case of a patterned background, however, it is more difficult 
for a definite difference in frequency to be produced than in 
the case of solid background. When the minimum value is 
used, however, extraction of background can be carried out 
in optimum fashion even if the background is patterned. 
[Area Separator] 

When the processing executed by the adaptive quantizer 
6 ends for all pixels that have been stored in the frame 
memory 123, the CPU 3 actuates the area separator 7 
irrespective of the logical value of background discrimina- 
tion flag bg, unlike in the first embodiment. The area 
separator 7 reads out the data stored in the frame memory 52, 
extracts a rectangular area which, based upon the feature of 
the image, is a character area, photographic area, line- 
drawing area or separator, and outputs area information 
which includes the positional coordinates of the area (e.g., 
the xy coordinates of the upper- left corner of the rectangular 
area), the size of the rectangular area and a code representing 
the result of area discrimination. This area information is 
stored in the area memory 14. 
[Transmission of Image Data] 

When processing executed by the adaptive quantizer 6 
ends with regard to all pixels stored in the frame memory 
123 and storage of the area information in the area memory 
14 ends, the CPU 3 sends the background candidate value b, 
which has been outputted by the background mscriminator 
5, to the communication line 13 via the synthesizer 11 and 
communication interface 12. 

Next, the CPU 3 reads the area information out of the area 
memory 14 successively, enters the read area information 
into the area information coder 8 and sends the coded area 
information to the synthesizer 11. If the rectangular area 
represented by the area information is a photographic area, 
the image data of the area read out of the frame memory 21 
of the background discriminator 5 are entered into the 
multivalued image coder 9 and the DPCM -coded image data 
are sent to the synthesizer 11. If the read area information is 
indicative of a character area, line-drawing area or separator, 
the image data of the area read out of the frame memory 52 
of the adaptive quantizer 6 and the image data of the area 
read out of the frame memory 21 of the background dis- 
criminator 5 are entered into the bi-level image coder 10 and 
the MMR-coded data and foreground color information 
(described in detail later) are sent to the synthesizer 11. 

The synthesizer 11 combines the coded area information, 
the code data obtained by coding the image data of the 
rectangular area represented by the area information and the 
foreground information and sends the resulting signal to the 
communication line 13 via the communication interface 12. 
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FIG. 10 is a block diagram showing the architecture of a 
bi-level image coder 10. 

As shown in FIG. 10, the bi-level image coder 10 includes 
a latch 161 for latching the RGB image data that have 
entered successively from the frame memory 21 of the 
background discriminator 5. When bi-level image data that 
have entered from the frame memory 52 of the adaptive 
quantizer 6 in sync with the RGB image data indicate "0" (a 
portion of the image other than background), the latch 161 
outputs the latched data. 

A frequency memory 162 is composed of memories for 
each of the R, G, B color components and has address 
terminals to which the R (red), G (green) and B (blue) data 
from the latch 161 are applied. An adder 163 adds 1 to its 
input data and outputs the result. More specifically, when 
RGB image data enter the frequency memory 162, the R, G, 
B values serves as addresses and the data stored in the 
respective memories are outputted. The data outputted by 
the frequency memory 162 has 1 added to it by the adder 
163, after which the data are stored in the frequency memory 
162 again. In other words, distributions of the R, G, B data 
representing image data from which background has been 
excluded are stored in the frequency memory 162. It should 
be noted that the frequency memory 162 is cleared by the 
CPU 3 before coding is performed. 

A maximum-frequency extractor 164 outputs, as RGB 
data, each address for which each RGB frequency stored in 
the frequency memory 162 indicates the maximum value. 
The RGB data for which the frequency is indicated as being 
maximum shall be referred to as the "foreground color" of 
the input image. An MMR coder 165 applies MMR coding 
to the bi-level image data that have entered from the frame 
memory 52 of the adaptive quantizer 6. 

If the read area information is indicative of a character 
area, photographic area, line-drawing area or separator, the 
CPU 3 reads the bi-level image data of this area out of the 
frame memory 52 of the adaptive quantizer 6 and the RGB 
multivalued image data out of the frame memory 21 of the 
background discriminator 5 synchronously and enters these 
data into the bi-level image coder 10. 

When frequency counting processing ends for all pixels in 
the area, the maximum-frequency extractor 164 extracts the 
foreground color information from the results of counting 
stored in the frequency memory 162 and outputs the fore- 
ground color to the synthesizer 11. Next, the CPU 3 reads the 
bi-level image data in the area out of the frame memory 52, 
causes the MMR coder 165 to apply MMR coding and 
outputs the coded data to the synthesizer 11. 
[Summary] 

In accordance with this embodiment, effects similar to 
those of the first embodiment can be obtained. Moreover, 
two sets of lower-limit values and upper-limit values of 
background densities are set. As a result, even if the back- 
ground of an input image exhibits a pattern, the areas of the 
image can be discriminated precisely and coding suited to 
the characteristics of each separated area can be applied to 
each area. 

An example has been described in which a luminance 
signal is generated from a color image, after which the 
image is separated into areas. However, this does not impose 
a limitation upon the invention. A G (green) signal may be 
used instead of the luminance signal, and a similar operation 
may be applied for each of the colors R, G, B. Further, 
CIE1976 L*u*v* or YIQ may be used as the uniform color 
space. Furthermore, an arrangement may be adopted in 
which areas are discriminated by prescanning, after which 
the color image is read in. 
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t . , When the processing of steps S6--S9 ends with regard to 

An image processing apparatus according to a third aU ^ m ^ area corresponding t0 ^ number of the 

embodiment of the present invention will now be described. CQUnt) ^ eds tQ sl0 Here hist[i] mdi _ 

Elements in .the third embodiment identical with those of the 5 ^ tfae maximum value (freque ncy of occurrence) is 

first embodiment are designated by like referent obtained m me histogram table and the parametcr i is 

and need not be described again. adopted as the value b of the background candidate. (In other 

[Architecture] words, hist[b] is the maximum value.) Next, at step Sll, the 

FIG. 11 is a block diagram illustrating an example in i ower _Umit value btO of the background candidate and the 

which an image processor according to the third embodi- 1Q upper . limit value btl of the background candidate are 

ment of the invention is applied to an image transmitting obtained and me background density width w is found in 

apparatus. accordance with the following equation: 

According to this embodiment, coding processing 

described in the first and second embodiments is executed w=bn-bio (i) 

by software, which has been stored in the ROM 3a, based 15 Next, at step S12, all histp] contained in the range of 

upon a command entered by the user employing a terminal values from lower- limit value btO of the background candi- 

203. Furthermore, here the RAM 3b has enough storage date to upper-limit value btl of the background candidate are 

capacity to implement this coding processing. summed, the sum is divided by the number m of pixels in the 

It will be assumed in the description below that the input area and background occupancy s is obtained as follows: 

image is a monochromatic multivalued image of eight bits 20 

per pixel, that the method of coding the multivalued image (2) 

is the JPEG coding method, and that the method of coding s = sumfm= £ hist[f\/m 

the bi-level image is the JBIG coding method. However, the f=WJ 
present invention is not limited to such an arrangement. 

[Processing Procedure] 25 Next ^ at step sl3 me background occupancy s is com- 

FIGS. 12 through 15 are flowcharts showing coding pared ^th mc threshold value Th3 and the background 

processing according to the third embodiment. If coding has density width w is compared with the threshold value Th2. 

been designated using the terminal 203, the CPU 3 executes If s>Th 3 w<Th2 hold, it is judged that the area has solid 

the processing of this flowchart in accordance with the background and the program proceeds to step S16, where 

program stored in the ROM 3a. 30 b t0 is substituted into the lower limit value bO of background 

Initialization and btl is substituted into the upper limit bl of background. 

The image data are read in from the storage unit 2 at step Further, if the background occupancy s and background 

SI. When the reading in of one frame of image data ends, the density width w do not satisfy the above-mentioned 

program proceeds to step S2. Here the count of areas is made conditions, the area is judged not to have solid background 

equal to one and the first record of an area information table 35 and the program proceeds to step S14. Here the second 

is created. Specifically, (0,0) is stored as "Positional Coor- lower-limit value bvO of the background candidate and 

dinates" of the upper left-hand corner of the rectangular second upper-limit value bvl of the background candidate 

area, image size is stored as "Image Size" representing the are obtained from the minima of histp]. This is followed by 

size of the rectangular area, and a code corresponding to an ste p S15, at which bvO is substituted into the lower limit 

as yet unseparated area is stored as a "Code" representing 40 value bO of background and bvl is substituted into the upper 

the result of discriminating the area. FIG. 16 A illustrates an hmit bl of background, 

example of the content of the area information table when Quantization 

the processing of step S2 has been completed. This illus- Adaptive quantization processing is executed next. First, 

trates an example in which 3,072x4,096 pixels have been a t step S17, it is determined whether quantization processing 

stored as "Area Size". 45 has been performed for all pixels in the rectangular area 

Next, at step S3, the value of the count is judged and, if recorded in the area table according to the number of the 

count^O holds, the program proceeds to step S4, where the count. If a pixel not yet processed still exists, the program 

histogram table histp] (i-0~255) is cleared in its entirety. proceeds to step S18, where the image data in the rectao- 

Extraction of Flat Pixels gular area recorded in the area information table according 

Extraction of flat pixels is performed next. First, at step 50 to the number of the count are read in successively and the 

S5, it is determined whether processing for extraction of flat pixel of interest p is compared with the lower-limit value bO 

pixels has been performed for all pixels in the rectangular and upper-limit value bl of the background. If b0<p<bl 

area recorded in the area table according to the number of holds, the binarized result q is made "1" at step S20; 

the count. If a pixel not yet processed still exists, the otherwise, q is made "0" at step S19. 

program proceeds to step S6, where the image data in the ss The pixel of interest is shifted to the next pixel at step S26, 

rectangular area recorded in the area information table at which the program returns to step S17. The binarized 

according to the number of the count are read in successively result q obtained is stored in memory as a bi-level image, 

and a value sm is obtained. The value sm is that at which the Area Separation 

absolute value of the difference between a pixel of interest When the processing of steps S18^S26 has ended for all 

p and a neighboring pixel x ( is maximum. Next, at step S7, 60 pixels in the area according to the number of the count, the 

the maximum difference value sm and a threshold value Th7 program proceeds to step S27, where the rectangular area, 

are compared. The program proceeds to step S9 if sm^Th7 namely the character area, photographic area, line-drawing 

holds. If sm<Th7 holds, hist[p] in the histogram table is area or separator, are extracted, on the basis of the features 

incremented at step S8 by reason of the fact that the pixel of of the image, from the bi-level image obtained by the 

interest p is a pixel forming a flat portion of the image. The 65 quantized result q. Next, at a step S28, the variable j is set 

pixel of interest is shifted to the next pixel at step S9, after one and newly extracted area information of count org- 

which the program returns to step S5. number of areas is written in the area information table as 
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contents of the area information table when the processing . . P , 

of step S28 has been completed. ! ma S e Processing apparatus according to a fourth 

Coding embodiment of the present invention will now be described. 

Coding processing is performed next. First, at step S29, it 5 In me fourth embodiment, only the architecture and opera- 
is determined whether coding of the extracted count_org- aon of the adaptive quantizer 6 differ from those of the first 
number of area items has been completed. If an unprocessed embodiment. Accordingly, in the description below, only the 
area exists, the program proceeds to step S30. If the code adaptive quantizer 6 will be described. Elements in the 
representing the result of discriminating the (count+j)th fourth embodiment identical with those of the first embodi- 
areas of the area information table represents the bi-level ment are designated by like reference characters and need 
image of a character, separator, line drawing or table ("YES" not be described again. 

at step S30), the program proceeds to step S31. FIG. 17 is a block diagram showing the architecture of the 

In a case where the area to be coded is a bi-level image, adaptive quantizer 6 according to the fourth embodiment. 

foreground-density extraction processing is executed at step A , . _ _ « _ . t . , . t . 

S3L More specifically, a histogram table histfg[i] is cleared , M shown 10 ^ 17 > the quantizer * includes a 

in its entirety, the bi-level image of this area is read in, the 15 framc memory 41 for stonng the input image, and an edge 

histogram table data (namely histhg[p]) of the pixel value p emphasizing circuit 42 for correcting the edge of an image. 

of a multivalued image corresponding to a pixel value of "0" More specifically, the edge emphasizing circuit 42 performs 

in the bi-level image is incremented and the density at which edge emphasis based upon a pixel of interest and its neigh- 

the histogram table data indicates the maximum value is " boring pixels read out of the frame memory 41. If we letD' 

adopted as foreground density f. 20 represent a pixel obtained by subjecting the pixel of interest 

Next, at step S32, the (count+j)th area information and the D to edge emphasis processing, edge emphasis may be 

foreground density f are coded and sent to the communica- expressed by the following equation, by way of example: 

tion line 13 via the communication interface 12. The bi-level 

image of this area is coded according to the JBIG standard 

at step S33 and then sent to the communication line 13 via 25 where D=X(ij) 

the communication interface 12, after which the program Al=Xfi-l \-XS 

proceeds to step S34. A^Xfi+l'i-tt 

In a case where the area to be coded is a multivalued . . 

image, it is determined at step S35 whether the number A3=X(i-lj+l) 

count_org of separated areas is one or not. If couot_org*l 30 A4=X(i+l,j+l) 

holds, the code of the (count+j)tb area is changed (step S38) i j: coordinate values 

to a code representing an as yet unseparated area (see record The comparator 45 compares the pixel of interest D which 

4 in FIG. 16C) and the program proceeds to step S34. has entered from the frame memory 41 with the upper-limit 

If count__org=l holds (i.e., if there are no separated value btl of the background candidate which has entered 

areas), the program proceeds to step S36, where the (count+ 35 from the background discriminator 5, outputs "1" if btl>D 

l)st area information is coded and then sent to the commu- holds and "0" otherwise. The comparator 46 compares the 

nication line 13 via the communication interface 12. The entered pixel of interest D with the lower- limit value btO of 

multivalued image of this area is subjected to JPEG coding the background candidate, outputs "l w if D>bt0 holds and 

at step S37 and the coded data is sent to the communication "0" otherwise. A comparator 47 compares the result D' of 

line 13 via the communication interface 12, after which the 40 edge emphasis applied to the pixel of interest and entered 

program proceeds to step S34. from the edge emphasizing circuit 42 with the upper-limit 

Next, the variable j is incremented at step S34, after which value btl of the background candidate, outputs " 1*' if btl >D f 

the program returns to step S29. When the inequality holds and "0" otherwise. A comparator 48 compares the 

j>count__org is established, the first record is deleted from result D' of edge emphasis with the lower-limit value btO of 

the area information table and so is the record in which the 45 the background candidate, outputs "1" if D'>bt0 holds and 

code representing "Character", "Separator", "Line Draw- "0" otherwise. The outputs of the comparators 45, 46 are 

ing" and "Table" has been recorded. The area information applied to an AND gate 49, the outputs of the comparators 

table is then reconstituted (see FIG. 16D) while filling the 47, 48 are applied to an AND gate 50, the outputs of the 

spaces let blank by the deleted portions, and the area count AND gates 49, 50 are applied to an OR gate 51, and the 

is enumerated. (In case of FIG. 16D, count-1 is established.) 50 output of the OR gate 51 is stored in the frame memory 52. 

In other words, after the first record (area) for which an The operation of the adaptive quantizer 6 will now be 

area has been separated and records (areas) having codes described. 

other than "Unseparated" have been deleted, the program When processing by the background discriminator Sends, 

returns to step S3. If count=0 holds (i.e., if there are no areas the CPU 3 reads image data out of the frame memory 21 of 

to be separated), all processing is terminated. In the example 55 background discriminator 5 successively and stores the data 

of FIG. 16D, an "Unseparated" area remains. Hence, the in the frame memory 41. When one frame of image data has 

processing from step S4 onward is repeated. been stored, the CPU reads out pixels of interest succes- 

[Summary] sively and causes the comparators 45 and 46 to perform the 

In accordance with this embodiment, effects similar to above-mentioned comparison operations. The AND between 

those of the first embodiment can be obtained. Moreover, by 60 the outputs of the two comparators 45, 46 is obtained by the 

separating areas repeatedly, binary coding is performed even AND gate 49. The output of the AND gate 49 is "1" if the 

with regard to flat areas in small sub-areas. As a result, pixel of interest D is between the upper-limit value btl of the 

coding efficiency is improved and, at the same time, char- background candidate and the lower-limit value btO of the 

acters and line drawings can be reproduced by binary values. background candidate and "0" otherwise. 

Accordingly, characters and line drawings undergo no dete- 65 The edge emphasizing circuit 42 applies the operation 

rioration and the quality of a transmitted image can be indicated by Equation (3) to the entered pixel of interest D 

improved. and four neighboring pixels A1-A4 and outputs the result D' 
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,tftvwrjti^'iof ;edge emphasis. -The-result D 'sis e ntered int0;the compara-. ^ , & The adaptive » quantizerj6*includesi the rse lectors vl47.i and t,T»i^jsu,iyi.£i- w 

tors 47, 48, which compare D' with the upper-limit value btl 148 for selecting and outputting inputs in accordance with 

of the background candidate and lower-limit value btO of the the background discriminating flag bg. The selector 148 

background candidate, respectively. The AND between the selects either the first or second lower-limit value of the 

outputs of the two comparators 47, 48 is obtained by the 5 background candidate and enters the selected lower-limit 

AND gate 50, the output of which is "1" if pixel D' after value of the background candidate into the comparators 46 

edge emphasis is between the upper-limit value btl of the and 48. The selector 147 selects either the first or second 

background candidate and the lower-limit value btO of the upper-limit value of the background candidate and enters the 

background candidate. Otherwise, the output of the AND selected upper- limit value of the background candidate into 

gate 50 is "0". the selector comparators 45 and 47. 

The OR gate 51 obtains the OR between the outputs of the The adaptive quantizer 6 further includes comparators 
AND gates 49 and 50. More specifically, the OR gate 51 149-152. The comparator 149 compares the background- 
outputs data "1" if the pixel of interest D is bracketed by the candidate value b with the edge-emphasized pixel value 
lower-limit value btO of the background candidate and outputted by the edge emphasizing circuit 42, produces a" 1" 
upper-limit value btl of the background candidate or if the output if the edge-emphasized pixel value is greater than the 
result D' of edge emphasis is bracketed by btO and btl. This 15 background-candidate value b and produces a "0" output at 
result is stored in the frame memory 52. Accordingly, the all other times. The comparator 150 compares the 
bi-level image of the background represented by data "1" is background-candidate value b with the pixel value outputted 
stored in the frame memory 52. by the frame memory 41, produces a "l w output if the 

Thus, according to this embodiment, background is dis- background -candid ate value b is greater than the pixel value 
criminated based upon the frequency distribution of pixel 20 and produces a "0" output at all other times. The comparator 
values in an input image to be coded, the background is 151 compares the background-candidate value b with the 
extracted and it is determined whether the background is pixel value outputted by the frame memory 41, produces a 
solid background or patterned background, just as in the first " 1" out P ut if me P™1 value is greater than the background- 
embodiment. If the background of the input image is solid candidate value b and produces a "0" output at all other 
background, then, according to the fourth embodiment, a 25 times The comparator 152 compares the background- 
bi-level image is formed from the input image and the candidate value b with the edge-emphasized pxxel value 
edge-emphasized input image based upon the density of the ? roduces a 1 ° ut P u ' lf the background-candidate value b 

extracted backeround areas such as character/line-drawine 15 grcatcr than edge-emphasized P^ 1 value and pro- 
extracted background, areas sucn as cnaracter/line drawing duces a U(yt QU flt ^ Qther timeg ^ AND 153 tflkes 

areas and photographic areas are separated from the bi-level ^ ^ bG{w ^ Q ^ ^ of ^ c * tors U9 and 

image and image data in these separated areas are coded 30 aQ ^ ^ ^ ^ ^ ^ & 

using a coding method suited to the area. If the back^ound of ^ com alors 151 m6 152> ^ the 0R te 51 obtains 

of the input image is patterned the entire image is coded by ^ QR Qf ^ QU from ^ ^ * 9 5Q ^ and 

multivalued-image coding without partitioning the image ° 

into areas, as set forth in the first embodiment. In accordance * _ , . . L 

with this embodiment, therefore, the following effects can 35 The operatton of the adap ive quantizer 6 wUl now be 

u i . j . ..... . , t *i_ a * described mainly with regard to the features that distinguish 

be-obtained in addition to those provided by the first . . . A c /. ° , c . , ,. 4 & 

, r it from that of the second and fourth embodiments, 
embodiment: 

(1) A bi-level image is formed from the input image and When Processing by the background discriminator 5 ends, 

the edge-corrected input image based upon the density of the **CBU 3 reads L* image data out of the frame memory 123 

extracted background, and the bi-level image is separated 40 of background discriminator 5 successively and stores the 

into areas. As a result, even low-contrast characters/line data * the fram( ; m l m °Z ?} 7*™ ° De ^ ? f 

drawings and outline characters can be separated correctly. has bcca stored the CPU 3 reads out pixels of interest 

Moreover, even if the edges of characters, line drawings or ^ ce ^i velv M * causes tbe comparators 45-48 and 

the like are indistinct at the start, erroneous discrimination 149 ~ 152 to P erfo ™ < he above-mentioned comparison 

when areas are separated can be prevented without causing 45 operations. The AMDs between the outputs of comparators 

thickening in the images obtained by binarizing these edges. 45 ' 46 > comparators 47, 48, comparators 149, 150 and 

Thus, an input image and an input image that has been comparators 151, 152 are obtained by the AND gates 49, 50, 

subjected to an edge correction are each binarized and areas 153 and 154 > respectively, the OR of the outputs from these 

are extracted utilizing a bi-level image which combines the ^ 1S ° btamed b ? the 0R 8 ate 51 > and the ° ut P ut of 

results of these binarizing operations. The method of extract- 50 the OR gate 51 is written in the frame memory 52. 

ing areas according to this embodiment of the invention wheo the background discrimination flag bg is "1" 

makes it possible to discriminate areas with a high degree of ( whic h represents solid background), the selector 147 selects 

precision and to extract character/line-drawing areas even in me first upper-limit value btl of the background candidate 

images that have undergone a negative/positive reversal. and the selector 148 selects the first lower-limit value btO of 

55 the background candidate. The operations of the compara- 

Fifth Embodiment tors 45.48 are as described in the first embodiment. That is, 

An image processing apparatus according to a second if the pixel of interest D is between the first upper-hmit value 

embodiment of the present invention will now be described. btl of the background candidate and the first lower-limit 

In the fifth embodiment, only the architecture and operation value btO of the background candidate, the output of the 

of the adaptive quantizer 6 differ from those of the second 60 AND gate 49 is "1"; otherwise, the output of the AND gate 

and fourth embodiments. Accordingly, in the description 49 is "0". If the edge -emphasized pixel D' is between the 

below, only the adaptive quantizer 6 will be described. upper-limit value btl of the background candidate and the 

Elements in the fifth embodiment identical with those of the lower-limit value btO of the background candidate, the 

second and fourth embodiments are designated by like output of the AND gate 50 is "1"; otherwise, the output is 

reference characters and need not be described again. . 65 "0". 

FIG. 18 is a block diagram showing the architecture of the When the background discrimination flag bg is "0" 

adaptive quantizer 6 according to the fourth embodiment. (which represents patterned background), the selector 147 
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candidate and the selector 148 selects the second lower-limit multivalued image. 

value bvO of the background candidate . If the pixel of Further, the foregoing embodiments make joint use of the 

interest D is between the second upper-limit value bvl of the background density width w and background occupancy s to 

background candidate and the second lower-limit value bvO 5 detect the state of background. However, either one of these 

of the background candidate, the output of the AND gate 49 mav be used. 

is "I"; otherwise, the output of the AND gate 49 is "0". If Iq accordancc ^ each of the f orcgoing embodiments, 

the edge-emphasized pixel D' is between the second upper- m ^ ^ M|cred ^ ^ of tfac background of the input 

hmit value bvl ^ of the background candidate and the second ^ ig discriminatedj the ^ t ^ a e ^ subjected t0 

lower-hmit value bvO of the background candidate, the 10 timum quantization based upon the state of the 

output of the AND gate 50 is 1 ; otherwise, the output is background> ^ mh discrimination is carried out based 

" upon the results of quantization. As a result, a plurality of 

Further, if the background-candidate value b is between coding means for performing coding that is best suited to the 

the pixel of interest D and the edge -emphasized pixel D\ the characteristics of the image are changed over accurately in 

outputs of the AND gates 153, 154 are "1"; otherwise, the is accordance with the results from the area discriminating 

outputs of these AND gates are "0". means. This makes possible highly efficient coding of 

More specifically, the OR gate 51 outputs data "1" with images while the quality thereof is maintained, 

regard to pixels bracketed by the upper-limit and lower-limit Fuzthcz, a pixel {oTming a flat po rtion ^ extracted from an 

values of the background candidates and with regard to image and the state of the background of the image is judged 

pixels for which the values before and after edge emphasis 20 from the freque ncy distribution. This makes it possible to 

bracket the background-candidate value b. Accordingly, a readily determine whether the background can be coded 

bi-levei image whose background is represented by data " 1" efficiently by bi-level image coding, 

is stored in the frame memory 52. In case of a patterned „ , . . » . . . « . , £ 

, , . . J j-fl-wr Further, by discriminating the background of an image 

background, however, it is more difficult tor a definite - - t ~ ~T , , . , , 

i ce • c * j j * . A , c r% from the frequency distribution of extracted background 

difference in frequency to be produced than m the case of " . . . , . c .. . . * i c *v • 

• . i i i j «fu . i • » , . , pixels, a wide view of the image can be taken of the image 

solid background. When the minimum value is used, , , t i ■ j- l j*? 

, * 4 . f . i . . • i and areas to undergo bi-level image codmg can be readily 

however, extraction of background can be carried out in . . , , At ;? . ? . & , . 

- - c 4 , l i j * „ * discriminated. At the same time, by usmg dynamic anth- 

optunum fashion even if the background is patterned. 4 . t , - . . J J i _i a 

r .... , ,T — ... metic coding, the area of the image can be enlarged. As a 

In accordance with this embodiment, effects similar to 3Q wsulu a bctter emergence rate is obtained, 

those of me fourth embodiment can be obtained. Moreover, r , , , . . . . 

two sets of lower-limit values and upper-limit values of » n " ^ ima ?' background is solid, quantization 

background densities are set. As a result, even if the back- wt f h **** b *<*Z™f density into account ^performed in 

ac *- uu* *u C4.u order to extract the background density and discriminate 

ground of an input image exhibits a pattern, the areas of the ? . * • j- • ■ 

• u I- — ■ * a -1 a j- ■♦ a * areas to good effect. Therefore, by performing area discnmi- 

lmaee can be discriminated precisely and coding suited to , B . , , ' j ' * . 6 . . - 

.. . . . c . , . , , . 3S nation based upon the results oi area discrimination, lnior- 

the characteristics of each separated area can be applied to . - , *. . . . *. , t 

r mation useful tor image area separation can be provided. 

eacn area. 

Furthermore, in a case where pixel values bracketing a Fari } eT > if ™ a f background is patterned, quantization is 

background-candidate value (background density) are cor- car " ed °<" f °«*. a manner that area discnrninauon can be 

reeled by edge emphasizing processing, e.g., in a case where „ P«&>nf d. Area discrimination can be earned out even ,n a 

an input pixel value is greater than the upper-limit value of 40 c^e where the distnbuhon of pixel values is as shown tn . 

a background candidate and the pixel value after edge or 

emphasis is less than the lower-limit value of the back- Further, using smoothing means makes it possible to 

ground candidate, the input image can be binarized appro- efficiently extract pixels forming flat portions from an image 

priately. while eliminating noise. 

t . r ^. , , T ,.,., ^ , Further, areas can be subdivided by repeating the parti- 

Modincations of First through Fifth Embodiments • r „ ™. „ : i_ . • , 

tiomng or the areas. Jnis provides even higher coding 

In each embodiment set forth above, examples are efficiency and improves image quality. 

described in which the image processor of this invention is Thus, a deterioration in high-frequency areas in character 

applied to an image transmission apparatus for coding an 5Q or line-drawing areas can be suppressed and it is possible to 

input image and sending the coded image to a communica- improve the quality of decoded images. 

tion line. However, this does not impose a limitation upon 

the invention. The invention can also be applied to an image Sixth Embodiment 

storage device in which a coded input image is stored on a ^ c ^ m whicfa me ^ processor of me preS ent 

storage medium such as a hard disk, optical disk, magneto- 5S fe applied to m ^ forming apparatus ^ te 

optical disk or CD-ROM, etc. described as a sixth embodiment of the invention. 

Further, the image space and number of bits in images to [Architecture] 

be coded according to present invention are not limited to p IG 19 is a sectional view showing the internal structure 

those set forth in the foregoing embodiments. For example, of a la^r-beam printer (LBP) 1100 according to the sixth 

any bit depth such as four bits or five bits may be adopted 60 embodiment of the present invention. The LBP 1100 is so 

in each of such image spaces CIE1976 L*a*b*, YMCK, adapted as to record character patterns from a data source 

HSL, etc. ( nost computer or the like), not shown, or standard forms 

Further, adaptive quantization is not limited to binariza- (form data), 

tion. Adaptive quantization into three levels also is possible. As shown in FIG. 19, printer has a main body 1100. 

Further, the coding methods are not limited to the fore- 65 Character information (character codes), form information 
going embodiments. Coding such as MH (modified or macro instructions, etc., supplied by an externally con- 
Huffman) coding may be used to obtain a bi-level image and nected host computer are entered and stored, character 



07/13/2004, EAST Version: 1.4.1 



5,995,665 

21 22 

t pattems.onfGnikpattern&^ara ; In. 'orderrto^simptify^ 

information and the resulting images are stored on recording assumed that image data entered from the terminal 308 is 

paper serving as the recording medium. multivalued monochromatic image data in which one pixel 

A control panel 1300 is provided with various switches is expressed by eight bits. (Specifically, a pixel can take on 

and LED indicators. A printer control unit 1101 exercises 5 any va ] ue D f o to 255, in which black is represented by 0). 

overall control of the LBP 1100 and analyzes character [Background Recognition Processing] 

information provided by the host computer. The printer Background recognition processing according to this 

control unit 1101 primarily converts character information to embodiment will be described in detail with reference to the 

a video signal of the corresponding character pattern and flowchart of FIG 21 

outputs the video signal to a laser driver 1102. Id addition, daU ^ from lermina , m ^ fa ^ 

the printer controT untf UM subjects entered image data to &ame * nG Qoe frame f 

various image processing. . JiU u * ^ ■ *t_ *m *l 

THe laser driver 1102, which is a circuit for driving a ™f *** * as bc ? n f red m the &ame ' ! 

semiconductor laser element 1103, turns the emission from CPU 3 * 2 *f m the ^logjam memory 303 to zero and 

the laser element 1103 on and off in dependence upon the resets other components of the apparatus. Furthermore, 

entered video signal. A laser light beam 1104 produced by 15 me histogram memory 303 is set to the write mode, 

the laser element 1103 is swept to the left and right by a pixel values are read ia tne flat-pixel extracting unit 302 

rotating polygonal mirror 1105 so as to scan a electrostatic from the frame memory 301 in order in the horizontal 

drum 1106. As a result, an electrostatic latent image of a scanning direction at step S102. The flat -pixel extracting 

character pattern is formed on the electrostatic drum 1106. unit 302 detennines whether a pixel that has been read in is 

The latent image is developed by a developing unit 1107 20 a pixel forming a flat portion of the image. If the pixel is 

surrounding the electrostatic drum 1106, after which the judged to be a flat pixel, the value of the pixel is outputted 

developed image is transferred to recording paper. Cut to generate a histogram in the histogram memory 303 (step 

sheets are used as the recording paper and are stored in a S103). 

paper cassette that has been loaded in the LBP 1100. The Flat-pixel Extracting Unit 

recording paper is fed into the apparatus by a feed roller 25 FIG. 22 is a block diagram showing the detailed archi- 

1109 and conveyance rollers 1110, 1111 so as to be supplied tecture of the flat -pixel extracting unit 302. 

to the electrostatic drum 1106. As shown in FIG. 22, the flat-pixel extracting unit 302 

This embodiment is characterized in that appropriate includes line buffers 321-323, which construct a FIFO 

background recognition processing is capable of being per- memory, an arithmetic unit 324 for reading the values of 

formed in the printer control unit 1101. By executing appro- 30 pixels neighboring a pixel of interest out of the line buffers 

priate background recognition processing, various subse- 321-323 and obtaining a mean value, line buffers 325-327 

quent image processing such as binarization can be executed constructing a FIFO memory, and a difference extracting 

in proper fashion in conformity with the background. unit 328 for reading the mean values of pixels neighboring 

FIG. 20 illustrates an arrangement for executing back- a pixel of interest out of the line buffers 325-327 and 

ground recognition processing in the printer control unit 35 obtaining a difference value between maximum and mini- 

1101. mum values of the mean values. 

As shown in FIG. 20, the arrangement includes a frame A comparator 329 compares an input value from the 

memory 301 for storing one frame of entered image data, a difference extracting unit 328 with a predetermined threshr 

flat-pixel extracting unit 302 for extracting flat pixels, and a old value Tl, outputs "1" if the input value is greater than the 

histogram memory 303 for storing a histogram. The histo- 40 threshold value Tl and outputs "0** otherwise. An address 

gram memory 303 has a write mode and a read mode. In the generator 330 generates the address of the histogram 

write mode, an entered value serves as an address and the memory 303, which is the next stage. A terminal 331 enters 

data indicated by the address are incremented. In the read pixel values successively in the horizontal scanning 

mode, the data indicated by the address are outputted. direction, a terminal 332 delivers the output of the compara- 

A background extracting unit 304 reads the histogram out 45 tor 329 to the histogram memory 303, and a terminal 333 

of the histogram memory 303, extracts background in for- outputs the address to the histogram memory 303. 

mation and outputs this information. A representative-pixel In the flat-pixel extracting unit 302 shown in FIG. 22, 

extracting unit 305 reads the histogram out of the histogram pixel values that have entered from the terminal 331 are 

memory 303, extracts information representing a applied to the line buffer 321. Three lines of pixel values are 

representative-pixel value and outputs this information. A 50 stored by the line buffers 321-323. By virtue of the line 

quantizer 306 quantizes entered image data based upon each buffers 321-323, a block of 3x3 pixels of a mean value 

representative pixel value. A sub-background area extracting centered on the pixel of interest can be formed. These values 

unit 307 extracts information representing sub-background enter the arithmetic unit 324 successively and the arithmetic 

areas from image data quantized by the quantizer 306. unit 324 proceeds to obtain the mean value of the pixels in 

A terminal 308 is for entering, image data. For example, 55 the block. The mean value obtained enters, the line buffer 

the terminal 308 may be connected to a scanner or the like 325. Three lines of mean values are stored by the line buffers 

for entering image data read in by the scanner. A terminal 325-327. These line buffers form a block of 3x3 pixels of 

309 is for outputting background information, a terminal mean values centered on the pixel of interest. These values 

310 is for outputting a representative-pixel value, and a enter the difference extracting unit 328 successively, 
terminal 311 is for outputting coordinates of a sub- 60 Of the mean values in the 3x3 pixel block, the difference 
background area and information relating to noise or the extracting unit 328 extracts the maximum and minimum 
like. values and finds the difference between them. The difference 

A CPU 312 performs overall control of the components value obtained enters the comparator 329, which compares 

mentioned above. A ROM 313 stores an operation program this value with the threshold value Tl. The mean value of the 

(for processing indicated by the flowchart of FIG. 21, 65 pixel of interest enters the address generator 330. The latter 

described below) executed by the CPU 312, and a RAM 314 generates the address of the histogram memory 303 from the 

is used as the working area of the CPU 312. mean value of the pixel of interest in line buffer 326 only 
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is outputted from the terminal 333. The terminal 332 deliv- entered into the comparator 341. The latter compares the 

ers the output of the comparator 329 to the histogram frequency values with the predetermined threshold value T2, 

memory 303. writes only the frequency values greater than T2 in the 

With reference again to FIG. 20, the output of the com- 5 histogram memory 342 at the corresponding addresses and 

parator 329 and the output of the address generator 330 of writes 0 in the histogram memory 342 in all other cases. 

FIG. 22 enter the histogram memory 303 in accordance with When comparison has been performed with regard to each 

the timing of the pixels. When the output of the comparator of the frequency values of all 256 levels and the values have 

329 is "0", the histogram memory 303 adds one to the been written in the histogram memory 342 in this manner, 

content of the address indicated by the address generator 330 10 the background-density candidate detector 343 goes to the 

and stores the result. In other words, data are written in the histogram memory 342 to read out a pixel value having the 

histogram memory 303 only if the difference between the highest frequency as a background-density candidate value 

maximum and minimum values in the mean -value block of and stores this value in the latch 346. 

pixels peripheral to the pixel of interest is less than the Thereafter, from those pixel values for which the fre- 

p redetermined threshold value Tl. 15 quency of occurrence is zero in the histogram, the base 

detector 344 extracts two values nearest to the background- 
Examples of Histograms density candidate valuc (one value bcing less man the 

FIGS. 23A through 23C are diagrams showing typical background-density candidate value and one value being 

examples of histograms created in this embodiment. FIG. greater) and obtains the difference between these two values. 

23A illustrates an example of a histogram of an image the 20 For example, in the examples of the histograms shown in 

entirety of which has a smooth grayscale, as in the case of FIGS. 23 A through 23c, the two values that are closest to the 

a photograph, or of an image whose background exhibits a background-density candidate value are SO and SI. 

pattern of some kind. FIG. 23B illustrates an example of a Accordingly, the base detector 344 outputs (S0-S1). 

histogram of an image in which a solid background (density The output of the base detector 344 enters the comparator 

K2) has a character or line drawing (density Kl). FIG. 23C 25 345, which compares this signal with the predetermined 

illustrates an example of a histogram of an image in which threshold value T3. The comparator 345 outputs "0" if its 

a solid background (density K3) has sub-area backgrounds input value is less than the threshold value T3. When the 

(density K2) of different densities as well as a character or output of the comparator 345 is "0*', the latch 346 outputs its 

lien drawing (density Kl). data from the terminal 348 as background density. The "0" 

Backaround Extracting Unit 30 output of the comparator 345, which indicates that the type 

When the above-described processing for creating a his- of background is solid, is delivered from the terminal 349. 

togram has ended with regard to all pixels in one frame of When the output of the comparator 345 is "1", on the other 

image data stored in the frame memory 301, the program hand, the data in the latch 346 is not outputted and the 

proceeds to step S104, at which the CPU 312 actuates the terminal 349 delivers logical "1", which indicates that the 

background extracting unit 304. 35 type of background is not solid and possesses a pattern of 

The details of the background extracting unit 304 are some kind. It should be noted that the threshold value T3 is 

illustrated in FIG. 24. decided by the precision with which the entered image is 

As shown in FIG. 24, the background extracting unit 304 read. For example, the threshold value T3 is decided based 

includes a special comparator 341 for comparing an input upon a variance value or the like which prevails when the 

value with a predetermined threshold value T2. If the input 40 solid image is read. 

value is greater than the threshold value T2, the comparator With reference again to FIG. 20, the signal from the 

341 outputs the input value as is; otherwise, zero is output- background extracting unit 304 representing the background 

ted. A histogram memory 342 stores the histogram outputted density and the type of background is delivered from the 

by the comparator 341. A background-density candidate terminal 309, as mentioned above. 

detector 343 detects the maximum frequency of occurrence 45 lo FIG. 21, the program proceeds to step S105, at which 

from the histogram stored in the histogram memory 342 and the signal representing the type of background outputted by 

outputs the pixel value (background-density candidate the background extracting unit 304 is investigated by the 

value) that gives this maximum frequency. CPU 312. The CPU 312 advances the program to step S106 

From those pixel values for which the frequency of to actuate the representative-pixel extracting unit 305 only 
occurrence is zero in the histogram, a base detector 344 50 when the type of background is solid background (i.e., only 
extracts two values nearest to the background -density can- when the output of the comparator 345 is "0"). On the hand, 
didate value (one value being less than the background- when the type of background is not solid but possesses 
density candidate value and one value being greater) and background of some sort (i.e., when the output of the 
obtains the difference between these two values. Acompara- comparator 345 is "1"), the CPU 312 terminates background 
tor 345 compares its input value with a predetermined 55 recognition processing without actuating the representative- 
threshold value T3, outputs "1" if the input value is greater pixel extracting unit 305 and, hence, without actuating the 
than the threshold value T3 and outputs "0" otherwise. A quantizer 306 and sub-background area extracting unit 307. 
latch 346 stores the value of the background-density candi- Representative-pixel Extracting Unit 
date. The data stored in the latch 346 are outputted only FIG. 25 is a block diagram showing the detailed archi- 
when the output of the comparator 345 is "0". 60 tecture of the representative-pixel extracting unit 305. 

Starting from a pixel value 0, a terminal 347 reads in the As shown in FIG. 25, the representative-pixel extracting 

corresponding frequency values from the histogram memory unit 305 includes a special comparator 351 for comparing an 

303 in regular order. A terminal 348 outputs the data input value with a predetermined threshold value T4. If the 

contained in the latch 346. A terminal 349 delivers the output input value is greater than the threshold value T4 the 

of the comparator 345. 65 comparator 351 outputs the input value as is; otherwise, zero 

The corresponding frequency values are read in from the is outputted. A histogram memory 352 stores the histogram 

histogram memory 303 via the terminal 347 in regular order outputted by the comparator 351. 
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successively reads in corresponding frequency values from 23B and 23C, for example, are stored in the representative- 
the histogram memory 352 in regular order, detects the pixel memory 359. The data in the representative-pixel 
maxima and successively outputs the maximal values that- memory 359 can be read out from the terminal 361 and the 
are the pixels giving the maxima as well as the values of the 5 count (the number P of representative-pixel values) in 
frequency of occurrence thereof. Starting the pixel value 0, counter 358 can be read out from terminal 362. It is possible 
a minima detector 354 successively reads in corresponding to read these values out of the terminal 311 at the same time 
frequency values from the histogram memory 352 in regular that they are entered into the quantizer 306 and sub- 
order, detects the minima and successively outputs the background area extracting unit 307 shown in FIG. 20. 
minimal values that are the pixels giving the minima as well 10 When a representative-pixel value has thus been obtained, 
as the values of the frequency of occurrence thereof. For the program proceeds to step S107. The CPU 312 actuates 
example, in the examples of the histograms shown in FIGS. the quantizer 306 and sub-background area extracting unit 
23B and 23C, the maximal values are Kl, K2 and K3, and 307 for each representative-pixel value Qi (i=l~P) obtained 
the minimal values are V0, VI, V2 and V3. (steps S107, S108). 

A max-min subtracter 355 obtains the frequency differ- 15 At step S107, the quantizer 306 reads the representative - 

ence between maxima and minima. More specifically, with pixel value Qi out of the representative -pixel memory 359 

regard to the frequency value at each maxima, the max-min shown in FIG. 25, reads out the pixel data from the frame 

subtractor 355 obtains the difference between this frequency memory 301 and performs quantization by assigning "1" to 

value and the frequency values at the minima on either side the value of a pixel whose value is between Qi-a and Qi+a 

of it and outputs the difference that is largest. A comparator 20 and "0" to the values of all other pixels from among the 

356 compares its input with a predetermined threshold value pixels that have been read in from the frame memory 301. 

T5, outputs "1" if the input value is greater than the In other words, in FIGS. 23B and 23C, only pixels contained 

threshold value T5 and outputs "0" in all other cases. in a range having a width of 2 a centered on each of the 

A latch 357 stores the maximal value outputted by the maximal values Kl, K2, K3 are quantized to "1"; all other 

maxima detector 353 and outputs its data only when the 25 pixels are quantized to "0". That is, quantization limits of 

output of the comparator 356 is "1". A counter 358 is Qi±a are decided by the typical pixel value Qi. 

incremented whenever the output of the comparator 356 is It should be noted that the width a is a predetermined 

"1". A representative-pixel memory 359 stores the value (a value. For example, the value is decided based upon a 

representative-pixel value) outputted by the latch 357. variance value or the like which prevails when an image 

Starting from a pixel value 0, a terminal 360 reads in the 30 formed on recording paper having a solid background has 

corresponding frequency values from the histogram memory been read. 

303 in regular order. A terminal 359 outputs the data Sub-background Area Extracting Unit 

contained in the representative-pixel memory 359. A termi- The program proceeds to step S108, at which the quan- 

nal 362 delivers the count recorded in the counter 358. tized image is entered into the sub-background area extract- 

The counter 358 in the representative -pixel extracting unit 35 ing unit 307. The latter extracts areas (pixel clusters) of 

305 is cleared to zero by the CPU 312 before operation continuous pixels for which the result of quantization is "1", 

starts. The corresponding frequency values are read in from extracts the rectangularity of each pixel cluster and deter- 

the histogram memory 303 via the terminal 360 in regular mines whether the area is a sub-background area based upon 

order starting from pixel value 0, and these frequency values the rectangularity. 

are entered into the comparator 351. The latter compares the 40 FIG. 26 is a block diagram showing the detailed archi- 

frequency values with the predetermined threshold value T4, tecture of the sub-background area extracting unit 307. 

writes only the frequency values greater than T4 in the As shown in FIG. 26, the sub-background area extracting 

histogram memory 352 at the corresponding addresses and unit 307 has a frame memory 370 for storing a quantized 

writes 0 in the histogram memory 352 in all other cases. image, a pixel-cluster extracting unit 371 for extracting a 

When comparison has been performed with regard to each 45 pixel cluster, a flag memory 372 and a pixel-cluster memory 

of the frequency values of all 256 levels and the values have 373 for storing information representing a extracted pixel 

been written in the histogram memory 352 in this manner, cluster. The flag memory 372 stores a flag indicating 

the maxima detector 353 and the minima detector 354 go to whether each pixel is contained in a pixel cluster, 

the histogram memory 352 to read in, starting from pixel Accordingly, the frame memory 370 and flag memory 372 

value 0, the corresponding frequency values in regular order 50 have identical storage capacities. 

and successively obtain maximal values Kn and minimal A circumscribed-rectangle calculating unit 374 calculates 

values Vn. the circumscribed rectangle of a pixel cluster, and a rectan- 

In the description that follows, it is assumed that H(x) gularity calculating unit 375 calculates the rectangularity of 

indicates a frequency value at a pixel value x. A frequency a pixel cluster. A comparator 376 compares its input value 

value FT(Kn) at a maxima obtained by. the maxima detector 55 with a predetermined threshold, value T6, outputs "1" if the 

353 also is latched by the latch 357. input value is greater than . the threshold value T6, and 

When, with regard to a certain maximal value Kn, the next outputs "0" otherwise. A latch 377 stores coordinate and size 

maximal value Vn+1 has been obtained, the max-min sub- information of the circumscribed rectangle of a pixel cluster, 

tractor 355 finds the differences [H(Kn)-H(Vn) and H(Kn)- The latch 377 outputs its contents only when the output of 

H(Vn+l)] and outputs the larger different to the comparator 60 the comparator 376 is "1". A sub-background area memory 

356. The latter compares this difference value with the 378 stores a representative-pixel value and the circum- 

predetermined threshold value T5 and outputs "1" if the scribed rectangle information from the latch 377. 

input value is larger. The counter 358 is incremented when A terminal 379 is for entering image data quantized by the 

the comparator 356 produces a "V* output. With the count quantizer 306, a terminal 380 is for reading in the 

from the counter 358 serving as an address, the data latched 65 representative-pixel value, which has been used by the 

by the latch 357 is written in the representative-pixel quantizer 306, from the representative-pixel memory 359 of 

memory 359. the representative-pixel extracting unit 305, and a terminal 
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memory 378 to the terminal 311 shown in FIG. 20. background area information stored in the sub-background 

The flag memory 372 is reset to "0" by the CPU 312 area memory 378 is outputted from the terminal 381. In 

before the sub-background area extracting unit 307 starts other words, this information can be outputted from the 

operating. The quantized image data are entered from the 5 terminal 311 shown in FIG. 20. 

terminal 379 and stored in the frame memory 370. When one Next, the program proceeds to step S109. Here it is 

frame of image memory has been stored in the frame determined whether the quantization at step S107 and the 

memory 370, the pixel-cluster extracting unit 371 scans the sub-background area extraction at step S108 have ended 

pixels of the frame memory 370 in the horizontal scanning with regard to all representative-pixel values Qi. If the 

direction, searches for a pixel whose pixel value is "1" and, io answer is "NO", then the program returns to step S107 and 

when such a pixel is found, reads in the value (flag) of the processing is repeated. 

corresponding address in the flag memory 372. If the flag is By repeating processing performed by the quantizer 306 
"1", then a search is made for the next pixel. If the flag is and processing performed by the sub-background area 
"0", then pixel-cluster extraction is carried out. extracting unit 307 a number of times (P times) equivalent 
The method of extracting a pixel cluster is not limited to 15 to the number of representative -pixel values Qi, sub- 
any particular method. For example, a technique similar to background area information is extracted for each 
a method of calculating a chain code may be applied. In such representative-pixel value Qi. 

case the shape of the extracted pixel cluster is represented by Accordingly, background information is outputted from 

the form of the chain code and the cluster is stored in the the terminal 309 in FIG. 20, all representative-pixel values 

pixel-cluster memory 373 successively together with the 20 are outputted from the terminal 310 and sub-background 

coordinates thereof. With regard to a pixel contained in an area information is outputted, for each representative-pixel 

extracted pixel cluster, the value at the corresponding posi- value, from the terminal 311. 

tion in the flag memory 372 is made "1*\ Accordingly, it will [Utilization of Background Information] 

suffice to extract a pixel cluster with respect solely to a pixel The information obtained in this embodiment in the 

whose flag is "0" in the flag memory 372. This makes it 25 manner set forth above is useful in various types of image 

possible to avoid re-processing contained in pixel cluster processing. An example in which this information is utilized 

and already processed. The result is shorter processing time. will now be described. 

When a pixel cluster contained in one frame of image data Consider a case in which a binarizer is provided at the 
has been extracted in the pixel-cluster extracting unit 371 in final stage of the arrangement for extracting background 
the manner described above, the information representing 30 information described in connection with FIG. 20. If a pixel 
the pixel cluster stored in the pixel-cluster memory 373 is of interest is contained in a sub-background area outputted 
read out successively and entered into the circumscribed- from the terminal 311, the binarizer compares this pixel with 
rectangle calculating unit 374. The latter obtains the upper- the corresponding representative -pixel value outputted from 
most pixel, lowermost pixel, rightmost pixel and leftmost the terminal 310. If the pixel of interest is close enough to 
pixel from the pixel-cluster information and generates a 35 the representative-pixel value, i.e., within a predetermined 
rectangle that contains these pixels. This is shown schemati- distance from the representative-pixel value, the binarizer 
cally in FIG. 27. The shaded portion in FIG. 27 is a pixel determines that the pixel of interest is background, 
cluster having contiguous flat pixel values The uppermost, Otherwise, the binarizer judges that the pixel of interest 
lowermost, rightmost and leftmost pixels of the pixel cluster constitutes information representing a character or the like in 
are indicated at 401, 402, 403 and 404, respectively. A 40 a background area. Thus, binarization is performed. In a case 
rectangle 400 containing the pixels 401, 402, 403 and 404 is where the pixel of interest does not reside in a sub- 
generated, background area, the binarizer compares the pixel of interest 

The rectangularity calculating unit 375 reads in the pixel- with the background density outputted from the terminal 

cluster information from the pixel-cluster memory 373, 309. The binarizer performs binariza tion by judging that the 

obtains an area having a width of p pixels (see FIG. 27) 45 pixel of interest is background if it is close to the background 

measured from the inner side of the circumscribed rectangle density and a pixel constituting character information or the 

and counts the number of pixels belonging to the pixel like if the pixel of interest is not close to the background 

cluster within this area. The rectangularity calculating unit density. 

375 divides this count by the total number of pixels inside Accordingly, if binarization processing is executed using 

the area of p pixel width, adopts the resulting value as 50 background information obtained by this embodiment, it is 

rectangularity and outputs this to the comparator 376. In possible to perform binarization that takes into account the 

other words, if the percentage of pixels belonging to the background density in a sub-area. 

pixel cluster inside the width of p pixels is high, it is judged Thus, in accordance with this embodiment as described 

that there is a good possibility that the pixel cluster is above, background information, all representative-pixel val- 

rectangular, i.e., that the rectangularity is high. It will suffice 55 ues and a sub-background area composed of these 

if the value of p is set to a suitable value in conformity with representative -pixel values can be extracted by extracting 

the particular apparatus. flat pixels from image data and detecting a cluster of these 

The circumscribed -rectangle information and pixel- pixels. Accordingly, in a case where sub-background area 

cluster position information enters from the circumscribed- density within the cells of a table is changed at will, each cell 

rectangle calculating unit 374 and pixel-cluster memory 373 60 can be properly recognized as rectangular information even 

are is latched in the latch 377. The comparator 376 compares if the ruled lines of the table are deleted, 

the calculated rectangularity with a threshold value T6 and This embodiment has been described for a case where the 

outputs "1" if the rectangularity is greater than T6. As a input image data are multivalued monochromatic image data 

result, the circumscribed-rectangle information and pixel- in which each pixel is represented by eight bits. However, 

cluster position information latched in the latch 377 is stored 65 this does not impose a limitation upon the invention, for 

as sub-background area information in the sub-background similar processing can be executed even with regard to color 

area memory 378 together with the representative-pixel images. More specifically, background information and sub- 
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similar to the foregoing for each of the color components R, values of pixels neighboring a pixel of interest out of the line 

G, B or Y, M, C, K and comparing background areas. buffers 521-523, 524-526, 527-529, respectively, and 

obtaining the respective mean values. The arithmetic unit 

Seventh Embodiment 5 530 calculates the mean value of lightness information L* 

A seventh embodiment of the invention will now be fr ° m / he buffers f 21 ^ the arithme ! ic UI * 53 J 

described. The architecture of the image processor to which calculates the mean value of ^chromaticity mformation a* 

4 , 4 . i 1 • , . 1 • 1 • ■ *! * t , . r .I. from the line buffers 524-526, and the arithmetic unit 532 

the seventh embodiment is applied is similar to that of the . . t tU , . . f .„ 

. . ... 4 , j . mi - calculates the mean value of chromaticity information b* 

sixth embodiment and need not be described again. from tfae linc 5uffers 527 ~529. 

FIG. 28 Ulustrates an arrangement for executing back- 10 Further, line buffers 533-541 construct a FIFO memory, 

ground recognition processing in a printer control unit 1101 a color-difference calculating unit 542 reads the mean 

according to a seventh embodiment of the invention. Com- values of pixels neighboring a pixel of interest out of the line 

ponents identical with those of the sixth embodiment shown buffers 533-541, calculates the color difference and obtains 

in FIG, 20 are designated by like reference characters and the maximum color-difference value. A comparator 543 

need not be described again. 15 compares an input value from the color-difference calculat- 

~> As shown in FIG. 28, the arrangement includes a frame ing unit 542 with a predetermined threshold value T7, 

memory 501 for storing one frame of entered full-color RGB 0Ut P uts "1" if the in P ul value * S reater than the threshold 

image data (24 bits per pixel), a color converter 502 for value T7 and outputs "0" otherwise. An address generator 

reading out pixels in order in the horizontal scanning direc- 544 A generates the address of the histogram memory 504 

tion and converting the RGB data to CIE1976 LW, 20 A terminal 547 delivers the output of the comparator 543 

L , . . . . c 1 . .. c to the histogram memory 505, and a terminal 548 outputs the 

^-which is uniform color space, a subsampling unit 503 for , , g , , , J ' , , r 

( t . it _ , r r , , . „ „ . address, which has been generated by the address generator 

subsampling the entered W values to 4:2:2 and a 544 tQ ^ hist J^n 505 

Jlat-pixel extracting unit 504 for extracting flat pixels. Iq ^ flat _ pixel extracliQg unit 504 shown in Fia 29j 

A histogram memory 505 stores a histogram. This is a 25 pixel data that have entered from the terminals 545, 546, 547 

solid histogram comprising the L*, a*, b* axes. The histo- are applied to the line buffers 521, 524, 527, respectively, 

gram memory has a write mode and a read mode. In the Three 1^ 0 f va i ue l* are store d by the line buffers 

write mode, an entered value serves as an address and the 521-523, three lines of pixel value a* are stored by the line 

data indicated by the address are incremented. In the read buffers 524-526, and three lines of pixel value b* are stored 

mode, the data indicated by the address are outputted. 3Q by the line buffers 527-529. By virtue of the line buffers 

A background extracting unit 506 reads the histogram out 521-529, a block of 3x3 pixels centered on the pixel of 

of the histogram memory 505 and outputs background interest is formed. 

information. A representative-pixel extracting unit 507 reads These values buffered by the line buffers 521-523, 

the histogram out of the histogram memory 505, extracts 524-526, 527-529 successively enter the arithmetic units 

information representing a representative-pixel value and 35 530-532, respectively, and the arithmetic units proceed to 

outputs this information. A quantizer 508 quantizes entered obtain the mean values. The mean values obtained by the 

image data based upon each representative pixel value. arithmetic units 530, 531 532 enter the line buffers 533, 536, 

A terminal 510 is for entering full-color RGB image data. 539, respectively. Three lines of mean values are stored by 

For example, the terminal 510 may be connected to a the line buffers 533-541. These line buffers form a block of 

scanner or the like for entering image data read in by the 40 3x3 pixels of mean values centered on the pixel of interest, 

scanner. A terminal 511 is for outputting background These values enter the color-difference calculating unit 542 

information, a terminal 512 is for outputting a successively. The color-difference calculating unit 542 

representative-pixel value, and a terminal 513 is for output- detects the color differences between the L*a*b* mean value 

ting coordinates of a sub-background area and information at the pixel of interest in the above-mentioned 3x3 pixel 

relating to size or the like. 45 block and the L*a*b* mean values at pixels neighboring the 

The RGB image data that have entered from the terminal pixel of interest and obtained the maximum difference value. 

510 are stored in the frame memory 501. When one frame Let (L*0, a*0, b*0) represent the L*a*b* mean value of 

of image data have been stored in the frame memory 501, the the pixel of interest, and let (L*n, a*n, b*n) represent the 

CPU 312 clears the histogram memory 505 to zero and L*a*b* mean values of pixels neighboring the pixel of 

resets the other components of the apparatus. Furthermore, 50 interest. The difference e between these mean values is given 

the CPU 312 sets the histogram memory 505 to the write by the following equation: 
mode. 

Pixel values are read in the color converter 502 from the e _ + _ a . n y ^ ^ Q _ ( 4 ) 
frame memory 501 in order in the horizontal scanning 

direction. The values of R, G, B read in are converted to L + , 55 

a*, b*, which are outputted to the subsampling unit 503. The The color-difference calculating unit 542 outputs the 

latter subsamples these data to 4:2:2 and outputs the result. maximum value of the color differences obtained. The 

Flat-pixel extracting unit maximum value enters the comparator 543 and is compared 

The flat-pixel extracting unit 504 determines whether a with the threshold value T7. Meanwhile, the mean values of 

pixel that has been read in is a pixel forming a flat portion 60 L*, a*, b* of the pixel of interest enter the address generator 

of the image. If the pixel is a flat pixel, the unit 504 outputs 544. The latter, which operates only if the output of the 

the value. The details of the flat-pixel extracting unit 504 comparator 543 is "0", outputs an address of the histogram 

will be described with reference to FIG. 29. memory 505 from the terminal 548. Further, the terminal 

As shown in FIG, 29, the flat-pixel extracting unit 504 547 delivers the output of the comparator 543 to the histo- 

includes terminals 545, 546, 547 for entering L*, a*, b* 65 gram memory 505. 

values, respectively, in order in the horizontal scanning With reference again to FIG. 28, the output of the corn- 
direction, line buffers 521-529, which construct a FIFO parator 543 and the output of the address generator 544 of 
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the timing of the pixels. When the output of the comparator type of background is not solid and possesses a pattern of 

543 is "0", the histogram memory 505 adds one to the some kind. 

content of the address indicated by the address generator 544 It should be noted that the threshold value T10 is decided 

and stores the result. In other words, data are written in the 5 by the precision with which the entered image is read. For 

histogram memory 505 only if the maximum value of the example, the threshold value T10 is decided based upon a 

color difference in the mean-value block of pixels peripheral variance value or the like which prevails when the solid 

to the pixel of interest is less than the predetermined image is read. 

threshold value T7. With reference again to FIG. 28, the signal from the 

Background Extracting Unit 10 background extracting unit 506 representing the background 

When the above-described processing has ended with density and the type of background is delivered from the 

regard to all pixels in one frame of image data stored in the terminal 511, as mentioned above. The signal representing 

frame memory 501, the CPU 312 actuates the background the type of background outputted by the background is 

extracting unit 506. investigated by the CPU 312. The CPU 312 actuates the 

The details of the background extracting unit 506 are 15 representative-pixel extracting unit 507 only when the type 

illustrated in FIG. 30. of background is solid background (i.e., only when the 

As shown in FIG. 30, the background extracting unit 506 output of the comparator 564 is "0"). On the hand, when the 
includes a special comparator 560 for comparing an input type of background is not solid but possesses background of 
value with a predetermined threshold value T8. If the input some sort (i.e., when the output of the comparator 564 is 
value is greater than the threshold value T8, the comparator 20 " 1"), the CPU 312 does not actuate the representative-pixel 
560 outputs the input value as is; otherwise, zero is output- extracting unit 507 and, hence, does not actuate the quan- 
ted. A histogram memory 561 stores the histogram outputted tizer 508 and sub-background area extracting unit 307. 
by the comparator 560. A background-density candidate Representative-pixel Extracting Unit 
detector 562 detects the maximum frequency of occurrence FIG. 31 is a block diagram showing the detailed archi- 
from the histogram stored in the histogram memory 561 and 25 tecture of the representative-pixel extracting unit 507. 
outputs the pixel value that gives this maximum frequency. As shown in FIG. 31, the representative-pixel extracting 
This pixel value serves as the background-den sity candidate unit 507 includes a special comparator 570 for comparing an 
valued " " ! input value with a predetermined threshold value Til. If the 

A radius detector 563 refers to the histogram stored in the input value is greater than the threshold value Til the 

histogram memory 561. From those pixels, in the vicinity of 30 comparator 570 outputs the input value as is; otherwise, zero 

the background-density candidate value, for which the fre- is outputted. A histogram memory 571 stores the histogram 

quency of occurrence is less than a predetermined threshold outputted by the comparator 570. Starting from a pixel value 

value T9, the radius detector 563 obtains the pixel that is 0, a representative-candidate detector 572 successively reads 

farthest from the background-density candidate value. A in corresponding frequency values from the histogram 

latch 565 stores the background-density candidate value. 35 memory 571 in regular order, extracts a group of pixel 

Starting from a pixel value 0, a terminal 566 reads in the values for which the frequency is not zero and adopts the 
corresponding frequency values from the histogram memory pixel value having the highest frequency of occurrence as a 
505 in regular order. A terminal 567 outputs the data representative-candidate value. From among representative- 
contained in the latch 565. A terminal 568 delivers the output candidate values extracted by the representative-candidate 
of the comparator 564. 40 detector 572, a diameter detector 573 obtains representative- 

The corresponding frequency values are read in from the candidate values whose frequencies are less than the prede- 

histogram memory 505 via the terminal 566 in regular order termined threshold value T9 and which are farthest apart. It 

starting from pixel value 0, and these frequency values are should be noted that the threshold value T9 is equal to the 

entered into the comparator 560. The latter compares the threshold value used by the radius detector 363 in the 

frequency values with the predetermined threshold value T8, 45 background extracting unit 306 shown in FIG. 20. 

writes only the frequency values greater than T8 in the A comparator 574 compares its input with a predeter- 

histogram memory 561 at the corresponding addresses and mined threshold value T12, outputs "1" if the input value is 

writes 0 in the histogram memory 561 in all other cases, greater than a threshold value T12 and outputs "0" in all 

When comparison has been performed with regard to each other cases. A latch 575 stores the representative-candidate 

of the frequency values of all 256 levels and the values have so value and outputs its data only when the output of the 

been written in the histogram memory 561 in this manner, comparator 574 is "1". A counter 576 is incremented when- 

the background-density candidate detector 562 goes to the ever the output of the comparator 574 is "1". A 

histogram memory 561 to read out a pixel value having the representative-pixel memory 577 stores the value (a 

highest frequency as a background-density candidate value representative-pixel value) outputted by the latch 575. 

and stores this value in the latch 565. 55 Starting from a pixel value 0, a terminal 578 reads in the 

Thereafter, the radius detector 563 refers to the histogram. corresponding frequency values from the histogram memory 

From those pixel values, in the vicinity of the background- 505 in regular order. A terminal 579 outputs the data 

density candidate value, for which the frequency of occur- contained in the representative -pixel memory 577. A termi- 

rence is less than a predetermined threshold value T10, the nal 580 delivers the count recorded in the counter 576. 

radius detector 563 obtains the pixel that is farthest from the 60 The counter 576 in the representative-pixel is reset to zero 

background-density candidate value. If the output of the by the CPU 312 before operation of the representative-pixel 

comparator 564 is "0*', the latch 346 outputs its data from the extracting unit 507 starts. The corresponding frequency 

terminal 567 as background density. The "0" output of the values are read in from the histogram memory 505 via the 

comparator 564, which indicates that the type of background terminal 578 in regular order starting from pixel value 0, and 

is solid, is delivered from the terminal 568. 65 these frequency values are entered into the comparator 570. 

When the output of the comparator 564 is "1", on the The latter compares the frequency values with the predeter- 

other hand, the data in the latch 565 is not outputted and the mined threshold value Til, writes only the frequency values 
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corresponding addresses and writes 0 in the histogram 
memory 571 in all other cases. 

When comparison has been performed with regard to each 
of the frequency values of all 256 levels and the values have 5 
been written in the histogram memory 571 in this manner, 
the representative-candidate detector 572 gpes to the histo- 
gram memory 571 to read in, starting from pixel value 0, the 
corresponding frequency values in regular order. When the 
representative-candidate detector 572 detects frequency val- 10 
ues which are not zero and which do not belong to a group 
of frequency values already extracted, the detector 572 
forms a group of values by extracting non-zero frequency 
values neighboring these detected values and outputs the 
pixel value having the highest frequency in this group. This is 
pixel value serves as the representative-candidate value. 

The comparator 574 compares this representative- 
candidate value with the threshold value T12. When the 
output of the comparator 574 is "1", the counter 576 is 
incremented. With the count from the counter 576 serving as 20 
an address, the data latched by the latch 575 is written in the 
representative -pixel memory 577. The data from the 
representative-pixel memory 577 are outputted from the 
terminal 579 and the count(the number P of representative- 
pixel values) in counter 576 is read out from terminal 580. 25 
It is possible to read these values out of the terminal 512 at 
the same time that they are entered into the quantizer 508 
and sub-background area extracting unit 307 shown in FIG. 
28. 

When a representative-pixel value has thus been obtained, 30 
the CPU 312 actuates the quantizer 508 and sub-background 
area extracting unit 307 for each representative-pixel value 
Qi (i=l~P) obtained. 

The quantizer 508 reads the representative-pixel value Qi 
out of the representative -pixel memory 577 shown in FIG. 35 
31, reads out the pixel data from the subsampling unit 503 
and performs quantization by assigning "1" to the value of 
a pixel whose value is between Qi-^y and Qi+*y and "0" to the 
values of all other pixels from among the pixels that have 
been read in from the subsampling unit 503. It should be 40 
noted that the width y is a predetermined value. For example, 
the value is decided based upon a variance value or the like 
which prevails when an image having a solid background 
has been read. 

TTie image quantized by the quantizer 508 enters the 45 
sub-background area extracting unit 307. In a manner simi- 
lar to that of the sixth embodiment, the sub-background area 
extracting unit 307 extracts clusters of pixels for which the 
result of quantization is "1", extracts the rectangularity of 
each pixel cluster and determines whether the area is a 50 
sub-background area based upon the rectangularity. 

By repeating processing performed by the quantizer 306 
and processing performed by the sub-background area 
extracting unit 307 a number of times (P times) equivalent 
to the number of representative-pixel values Qi, sub- 55 
background area information is extracted for each 
representative -pixel value Qi. Accordingly, background 
information is outputted from the terrninal 511 in FIG. 28, all 
representative-pixel values are outputted from the terminal 
512 and sub-background area information is outputted, for 60 
each representative -pixel value, from the terminal 513. 

Thus, in accordance with the seventh embodiment as 
described above, flat pixels are extracted after a color image 
is converted to uniform color space, and background 
information, all representative-pixel values and a sub- 65 
background area composed of these representative-pixel 
values can be extracted in conformity with the color differ- 



ence. ^ Accordingly,- in^ai case- where * sub-background varea ^u-i^.^t. ■^swa'csv.*^ 
density within the cells of a table is changed at will, each cell 
can be properly recognized as rectangular information even 
if the ruled lines of the table are deleted. 

Eighth Embodiment 

An eighth embodiment of the invention will now be 
described. The architecture of the image processor to which 
the eighth embodiment is applied is similar to that of the 
sixth embodiment and need not be described again. 

FIG. 32 illustrates an arrangement for executing back- 
ground recognition processing in a printer control unit 1101 
according to an eighth embodiment of the invention. Com- 
ponents identical with those of the sixth embodiment shown 
in FIG. 20 and the seventh embodiment shown in FIG. 28 
are designated by like reference characters and need not be 
described again. 

As shown in FIG. 32, the arrangement includes a lumi- 
nance converter 601 for reading pixels out of the frame 
memory 501 in order in the horizontal scanning direction 
and converting the RGB data to lightness information L* of 
CIE1976 L*a*b*, which is uniform color space, a quantizer 
602 for linearly quantizing the entered L* data of eight bits 
to six bits, and a flat-pixel extracting unit 603 for extracting 
flat pixels from the quantized L* data. 

A histogram memory 604 stores a histogram the horizon- 
tal axis of which indicates six bits of the L* value. The 
histogram memory 604 has a write mode and a read mode. 
In the write mode, an entered value serves as an address and 
the data indicated by the address are incremented. In the read 
mode, the data indicated by the address are outputted. 

A background extracting unit 605 reads the histogram out 
of the histogram memory 604 and outputs background 
information. A representative-pixel extracting unit 606 reads 
the histogram out of the histogram memory 604, extracts 
information representing a representative-pixel value and 
outputs this information upon expanding it to eight bits. A 
frame memory 607 stores one frame of L* data. 

In FIG. 32, RGB image data expressed by eight bits that 
have entered from the terminal 510 are stored in the frame 
memory 501. When one frame of image data have been 
stored in the frame memory 501, the CPU 312 clears the 
histogram memory 604 to zero and resets the other compo- 
nents of the apparatus. Furthermore, the CPU 312 sets the 
histogram memory 604 to the write mode. 

Pixel values are read in the luminance converter 601 from 
the frame memory 501 in order in the horizontal scanning 
direction. The values of R, G, B read in are converted to L* 
of eight bits, which are outputted. Each color-space con- 
verted pixel value of eight bits is converted to a value of six 
bits by the quantizer 602, whereby smoothing is performed. 

The flat-pixel extracting unit 603 determines whether a 
pixel outputted by the quantizer 602 is a pixel forming a flat 
portion of the image. If the pixel is a flat pixel, the unit 603 
outputs the value. The detailed construction of the flat-pixel 
extracting unit 603 is similar to that of the unit according to 
the sixth embodiment shown in FIG. 22. However, the bit 
length of the data to be processed in each block and the value 
of the threshold value Tl differ. 

As in the sixth embodiment, data are written in the 
histogram memory 604 only if the difference between the 
maximum value and minimum value in each mean-value 
block of pixels surrounding the pixel of interest is less than 
the predetermined value (Tl). It should be noted that the 
histogram memory 604 has frequency values corresponding 
to all 64 levels. 
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has ended for all pixels, the CPU actuates the background of an NTSC signal or CIE1976 L*u*v*. 

extracting unit 605. The construction of the background In other to expedite the description, arrangements using 

extracting unit 605 is similar to that shown in FIG. 24 frame memories have been described. However, it is of 

according to the sixth embodiment. However, the bit length 5 course permissible to adopt a hardware configuration in 

of the data to be processed in each block and the values of which ^ buffers are ^ instead. 

the threshold values T2, T3 differ. The background extract- Further, the method of comparing rectangulanty is not 

ing unit 605 outputs the background density value and the limited to the above-described example (in which a chain 

type of background. The CPU 312 investigates the type of code is calculated). For example, it is permissible to count 

background and proceeds to control the operation of the 10 the directions of chain codes surrounding a pixel cluster, and 

blocks from the representative -pixel extracting unit 606 il ^ permissible to judge rectangulanty using a parameter 

onward. SUCD as tne linearity of the periphery or the angle of the 

When the output from the background extracting unit 605 intersection of straight lines, 

ends, the CPU 312 actuates the representative-pixel extract- , ?" rt f her ' ,he P rese ° l ' nven,10n * a PP hed «? ,? n ln , each 

ing unit 606 only if the type of background is solid. The « of ^ fore .g° ia 8 embodiments. However, if the apparatus is 

construction of the representative-pixel extracting unit 606 one squiring processing for recognizing the background of 

is similar to that shown in FIG. 25 according to the sixth an image, such as a copier, facsimile machine or scanner, the 

embodiment. However, the bit length of the data to be mv , eatloa » WhaMe to any image processor, 

processed in each block and the values of the threshold u In a ^° rfa °f P™** invention as described 

values T4, T5 differ. By writing the extracted representative- 20 above, flat pixels are extracted from image data, a histogram 

pixel values at the six higher order bitsof the representative- T ?' *T u back S ro " nd 1 of ,he 

pixel memory 359 and writing "0" at the two lower order 15 J udged , bai * d " p ° n he h * l °S<™' background density is 

f - 4 . -11 j * u * extracted and sub-background areas constituting sub-areas 

bits, the representative -pixel values are stored as eight-bit . . , , , 

( j ata can be extracted efficiently. As a result, even if background 

1S is not white, a rectangular density portion at background 

When all representative-pixel values have been obtained such ^ a character of ta51e ^ 5e subje cted to ground 

in the manner described above, the CPU 312 actuates the recognit i on appropriately and it possible to perform proper 

quantizer 306 and the sub-background area extracting unit haB ^ processing such as binarization or area separation that 

307 for every representative-pixel value Qi (M-F). ^ background deosity of rect angular information into 

The quantizer 306 reads the representative-pixel value Qi 3Q account, 

out of the representative-pixel memory 359 shown in FIG. The above-mentioned effects can be obtained with regard 

25, and performs quantization by assigning " 1" to the value to color images as well. 

of a pixel whose value is between Qi-6 and Qi+6 and T Further, by performing background recognition after 

to the values of all other pixels. It should be noted that the image data are smoothed, noise can be eliminated and the 

width 8 is a predetermined value. For example, the value is 3S amount of data processed can be suppressed. As a result, 

decided based upon a variance value or the like which better background recognition can be carried out and, at the 

prevails when an image having a solid background has been same time, less memory capacity suffices and processing 

reao ** speed can be raised. 

The quantized image enters the sub-background area OTHER EMBODIMENT 

extracting unit 307. In a manner similar to that of the sixth ^ 

embodiment; the sub-background area extracting unit 307 The present invention can be applied to a system consti- . ... 

extracts clusters of pixels for which the result of quantiza- tuted by a plurality of devices (e.g., host computer, interface, 

tion is extracts the rectangulanty of each pixel cluster reader, printer) or to an apparatus comprising a single device 

and determines whether the area is a sub-background area ( c -g > C0 P V machine, facsimile). 

based upon the rectangulanty. 45 Further, the object of the present invention can be also 

Accordingly, background information is outputted from achieved by providing a storage medium storing program 

the terminal 609 in FIG. 32, all representative-pixel values codes for performing the aforesaid processes to a system or 

are outputted from the terminal 610 and sub-background an apparatus, reading the program codes with a computer 

area information is outputted, for each representative-pixel ( e S •> cpu > MPU) of the system or apparatus from the 

value, from the terminal 611. 50 stora g e medium, then executing the program. 

Thus, in accordance with the eighth embodiment as Io mis case - the P r °g ram codes read from tbe storage 

described above, an entered color image is smoothed after medium realize the functions according to the embodiments, 

being subjected to a luminance conversion, and background and the storage medium storing the program codes consti- 

information, all representative-pixel values and a sub- tne invention. 

background area composed of these representative-pixel 55 Further, the storage medium, such as a floppy disk, a hard 

values can be extracted from the smoothed image. ^ optical disk, a magneto -optical disk, CD-ROM, 

Accordingly, background recognition can be carried out CD-R, a magnetic tape, a non-volatile type memory card, 

after noise contained in the entered image data is suitably and R0M can be used for providing the program codes, 

eliminated. This makes better recognition processing pos- Furthermore, besides aforesaid functions according to the 

sible. Since the number of bits in image data to be processed 60 above embodiments are realized by executing the program 

is reduced, less memory capacity suffices and processing codes which are read by a computer, the present invention 

speed can be raised. includes a case where an OS (Operating System) or the like 

[Modifications of Sixth through Eighth Embodiments] working on the computer performs a part or entire processes 

In each embodiment set forth above, it is described that an in accordance with designations of the program codes and 

image signal is expressed by eight or six bits per pixel. 65 realizes functions according to the above embodiments. 

However, this does not impose a limitation upon the Furthermore, the present invention also includes a case 

invention, for 12-bit representation may be used as well. In where, after the program codes read from the storage 
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;^medium5are »writtenJn«ar>fiiiictionv.expansion: card^which^issv: 
inserted into the computer or in a memory provided in a 
function expansion unit which is connected to the computer, 
CPU or the like contained in the function expansion card or 
unit performs a part or entire process in accordance with : 
designations of the program codes and realizes functions of 
the above embodiments. 
What is claimed is: 

1. An image processing apparatus comprising: 
discriminating means for discriminating state of back- 
ground of an input image; 

quantizing means for quantizing the input image based 
upon results of discrimination from said discriminating 
means; 

partitioning means for partitioning the input image into 
areas based upon results of quantization from said 
quantizing means; and 
coding means for coding each partitioned area in confor- 
mity with characteristics of the area, 
wherein said discrimination means comprises: 

extracting means for extracting, from the input image, 

pixels forming a flat portion of the image, 
counting means for counting frequency of occurrence 

of the value of each extracted flat pixel, and 
detecting means for detecting the state of the back- 
ground of the input image from a distribution of 
frequencies obtained by said counting means. 

2. The apparatus according to claim 1, wherein said 
detecting means detects a first density width of background 
from the frequency distribution and detects the state of the 
background based upon the first density width detected. 

3. The apparatus according to claim 1, wherein said 
detecting means detects a first density width of background 
from the frequency distribution, calculates occupancy of the 
entire image by the background based upon the detected first 
density width, and detects the state of the background based 
upon at least one of the first density width and occupancy. 

4. The apparatus according to claim 3, wherein said 
detecting means detects a second density width of back- 
ground from the frequency distribution, said second density 
width being smaller than said first density width. 

5. An image processing apparatus comprising: 
discriminating means for discriminating state of back- 
ground of an input image; 

quantizing means for quantizing the input image based 
upon results of discrimination from said discriminating 
means; 

partitioning means for partitioning the input image into 
areas based upon results of quantization from said 
quantizing means; and 

coding means for coding each partitioned area in confor- 
mity with characteristics of the area, 

wherein said discriminating means comprises: 
smoothing means for smoothing the input image, 
extracting means for extracting, from the smoothed 
input image, pixels forming a flat portion of the 
image, 

counting means for counting frequency of occurrence 
of the value of each extracted flat pixel, and 

detecting means for detecting the state of the back- 
ground of the input image from a distribution of 
frequencies obtained by said counting means. 

6. The apparatus according to claim 5, wherein said 
detecting means detects a first density width of background 
from the frequency distribution and detects the state of the 
background based upon the first density width detected. 
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detecting means detects a first density width of background 
from the frequency distribution, calculates occupancy of the 
entire image by the background based upon the detected first 
density width, and detects the state of the background based 
upon at least one of the first density width and occupancy. 

8. The apparatus according to claim 7, wherein said 
detecting means detects a second density width of back- 
ground from the frequency distribution, said second density 
width being smaller than said first density width. 

9. The apparatus according to claim 1, wherein said 
quantizing means forms a quantized image of the back- 
ground by quantizing the input image based upon a density 
width of the background discriminated by said discriminat- 
ing means. 

10. Hie apparatus according to claim 1, wherein said 
partitioning means performs area partitioning repeatedly 
with respect to an area having characteristics of a multival- 
ued image. 

11. An image processing method comprising the steps of: 
discriminating state of background of an input image; 
quantizing the input image based upon results of discrimi- 
nation obtained in the discriminating step; 

partitioning the input image into areas based upon results 

of quantization obtained in the quantizing step; and 
coding each partitioned area in conformity with charac- 
teristics of the area, 
wherein the discrimination step comprises the steps of: 
extracting, from the input image, pixels forming a flat 

portion of the image, 
counting frequency of occurrence of the value of each 

extracted flat pixels, and 
detecting the state of the background of the input image 
from a distribution of frequencies obtained in the 
counting step. 

12. An image processing apparatus comprising: 
discriminating means for discriminating state of back- 
ground of an input image; 

correcting means for correcting the input image; 

quantizing means for quantizing the input image based 
upon results of discrimination from said discriminating 
means, quantizing the image, which has been corrected 
by said correcting means, based upon the results of 
discrimination, and combining results of both quantiz- 
ing operations; 

partitioning means for partitioning the input image into 
areas based upon the combined results of quantization; 
and 

coding means for coding each partitioned area in confor- 
mity with characteristics of the area, 
wherein said discrimination means comprises: 

extracting means for extracting, from the input image, 

pixels forming a flat portion of the image, 
counting means for counting frequency of occurrence 

of the value of each extracted flat pixel, and 
detecting means for detecting the state of the back- 
ground of the input image from a distribution of 
frequencies obtained by said counting means. 

13. An image processing apparatus comprising: 
discriminating means for discriminating state of back- 
ground of an input image; 

correcting means for correcting the input image; 

quantizing means for quantizing the input image based 
upon results of discrimination from said discriminating 
means, quantizing the image, which has been corrected 
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discrimination, and combining results of both quantiz- 
ing operations; 
partitioning means for partitioning the input image into 
areas based upon the combined results of quantization; 5 
and 

coding means for coding each partitioned area in confor- 
mity with characteristics of the area, 
wherein said discriminating means comprises: 
smoothing means for smoothing the input image, 
extracting means for extracting, from the smoothed 
input image, pixels forming a flat portion of the 
image, 

counting means for counting frequency of occurrence 
of the value of each extracted flat pixel, and 5 

detecting means for detecting the state of the back- 
ground of the input image from a distribution of 
frequencies obtained by said counting means. 

14. The apparatus according to claim 13, wherein said 
detecting means detects a first density width of background 
from the frequency distribution and detects the state of the 20 
background based upon the first density width detected. 

15. The apparatus according to claim 13, wherein said 
detecting means detects a first density width of background 
from the frequency distribution, calculates occupancy of the 
entire image by the background based upon the detected first 
density width, and detects the state of the background based 
upon at least one of the first density width and the occu- 
pancy. 

16. The apparatus according to claim 15, wherein said 
detecting means detects a second density width of back- 
ground from the frequency distribution, said second density 
width being smaller than said first density width. 

17. The apparatus according to claim 12, wherein said 
correcting means applies edge emphasizing processing to 
the input image. 

18. The apparatus according to claim 12, wherein said 
quantizing means forms a quantized image of the back- 
ground by quantizing the input image and the corrected 
image based upon a density width of the background dis- 
criminated by said discriminating means. 

19. The apparatus according to claim 12, wherein said 
partitioning means performs area partitioning repeatedly 
with respect to an area having characteristics of a multival- 
ued image. 

20. An image processing method comprising the steps of: 
discriminating state of background of an input image; 
correcting the input image; 

quantizing the input image based upon results of discrimi- 
nation obtained in the discriminating step; 5Q 

quantizing the image, which has been corrected in the 
correcting step, based upon the results of discrimina- 
tion; 

combining results of quantization obtained in the quan- 
tizing steps; 55 
partitioning the input image into areas based upon the 

combined results of quantization; and 
coding each partitioned area in conformity with charac- 
teristics of the area, 
wherein the discriminating step comprises the steps of: 60 
extracting from the input image, pixels forming a flat 

portion the image, 
counting frequency of occurrence of the value of each 

extracted flat pixel, and 
detecting the state of the background of the input image 65 
from a distribution of frequencies obtained in the 
counting step. 
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discriminating means for discriminating state of back- 
ground of an input image; 

correcting means for correcting the input image; 

first quantizing means for quantizing the input image 
based upon results of discrimination from said dis- 
criminating means; 

second quantizing means for quantizing the image, which 
has been corrected by said correcting means, based 
upon the results of discrimination; 

third quantizing means for quantizing the input image 
based upon the results of discrimination, the input 
image and the input image corrected by said correcting 
means; 

combining means for combining results of quantization 
obtained from said first, second and third quantizing 
means; 

partitioning means for partitioning the input image into 
areas based upon the combined results of quantization; 
and 

coding means for coding each partitioned area in confor- 
mity with characteristics of the area, 
wherein said discrimination means comprises: 

extracting means for extracting, from the input image, 

pixels forming a flat portion of the image, 
counting means for counting frequency of occurrence 

of the value of each extracted flat pixel, and 
detecting means for detecting the state of the back- 
ground of the input image from a distribution of 
frequencies obtained by said counting means. 

22. An image processing apparatus comprising; 
discriminating means for discriminating state of back- 
ground of an input image; 

correcting means for correcting the input image; 

first quantizing means for quantizing the input image 
based upon results of discrimination from said dis- 
criminating means; 

second quantizing means for quantizing the image, which ^ 

has been corrected by said correcting means, based 
upon the results of discrimination; 

third quantizing means for quantizing the input image 
based upon the results of discrirnination, said input 
image and the input image corrected by said correcting 
means; 

combining means for combining results of quantization 
obtained from said first, second and third quantizing 
means; 

partitioning means for partitioning the input image into 
areas based upon the combined results of quantization; 
and 

coding means for coding each partitioned area in confor- 
mity with characteristics of the area, 
wherein said discriminating means comprises: 
smoothing means for smoothing the input image, 
extracting means for extracting, from the smoothed 
input image pixels forming a flat portion of the 
image, 

counting means for counting frequency of occurrence 
of the value of each extracted flat pixel, and 

detecting means for detecting the state of the back- 
ground of the input image from a distribution of 
frequencies obtained by said counting means. 

23. The apparatus according to claim 22, wherein said 
detecting means detects a first density width of background 
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background based upon the first density width detected. 

24. The apparatus according to claim 22, wherein said 
detecting means detects a first density width of background 
from the frequency distribution, calculates occupancy of the 5 
entire image by the background based upon the detected first 
density width, and detects the state of the background based 
upon at least one of the first density width and the occu- 
pancy. 

25. The apparatus according to claim 24, wherein said 1Q 
detecting means detects a second density width of back- 
ground from the frequency distribution, said second density 
width being smaller than said first density width. 

26. The apparatus according to claim 21, wherein said 
correcting means applies edge emphasizing processing to 
the input image. 15 

27. The apparatus according to claim 21, wherein said first 
and second quantizing means form a quantized image of the 
background by quantizing the input image and the corrected 
image based upon a density width of the background dis- 
criminated by said discriminating means. 20 

28. The apparatus according to claim 27, wherein said first 
and second quantizing means select the first density width or 
the second density width in conformity with the state of the 
background and form a quantized image of the background 
by quantizing the input image and the corrected image based 25 
upon a density width selected. 

29. The apparatus according to claim 21, wherein said 
third quantizing means forms a quantized image of the 
background by quantizing the input image based upon 
density of the background discriminated by said discrimi- 3Q 
nating means, said input image and the corrected image. 

30. The apparatus according to claim 29, wherein when 
the value of a pixel of interest in the input image and the 
value of a corrected pixel obtained by correcting the pixel of 
pixel of interest bracket the density of the background, said 
third quantizing means quantizes the pixel of interest as a 35 
pixel forming the background. 

31. An image processing method comprising the steps of: 
discriminating state of background of an input image; 
correcting the input image; 4Q 
quantizing the input image based upon results of discrimi- 
nation obtained in the discriminating step; 

quantizing the image, which has been corrected in the 
correcting step, based upon the results of discrimina- 
tion; 45 

quantizing the input image based upon the results of 
discrimination, the input image and the input image 
corrected in the correcting step; 

combining of quantization obtained, in the quantizing 
steps; 50 

partitioning the input image into areas based upon the 
combined results of quantization; and 

coding each partitioned area in conformity with charac- 
teristics of the area, ss 

wherein the discrimination step comprises the steps of: 
extracting, from the input image, pixels forming a flat 

portion of the image, 
counting frequency of occurrence of the value of each 

extracted flat pixel, and 60 
detecting the state of the background of the input image 
from a distribution of frequencies obtained in the 
counting means. 

32. An image processing method comprising the steps of: 
discriminating state of background of an input image; 55 
quantizing the input image based upon results of the 

discrimination; 



partitioning: the* input, imagerinto-iare as-J>ased;upon .results:^;**: 
of the quantization; and 

coding each partitioned area in conformity with charac- 
teristics of the area, 

wherein the discriminating step comprises the steps of: 
smoothing the input image, 

extracting, from the smoothed input image, pixels 

forming a flat portion of the image, 
counting means for counting frequency of occurrence 

of the value of each extracted flat pixel, and 
detecting the state of the background of the input image 

from a distribution of frequencies obtained in the 

counting step. 

33. An image processing method comprising the steps of: 
discriminating state of background of an input image; 
correcting the input image; 

quantizing the input image based upon results of the 
discrimination; 

quantizing the image, which has been corrected in the 
correcting step, based upon the results of discrimina- 
tion; 

combining results of both quantizing operations; 

partitioning the input image into areas based upon the 
combined results of quantization; and 

coding each partitioned area in conformity with charac- 
teristics of the area, 

wherein the discriminating step comprises the steps of: 
smoothing the input image, 

extracting, from the smoothed input image, pixels 

forming a flat portion of the image, 
counting frequency of occurrence of the value of each 

extracted flat pixel, and 
detecting the state of the background of the input image 

from a distribution of frequencies obtained in the 

counting step. 

34. An image processing method comprising the steps of: 
discriminating state of background of an input image; 
correcting the input image; 

quantizing the input image based upon results of discrimi- 
nation from said discriminating means; 

quantizing the image, which has been corrected by said 
correcting means, based upon the results of discrimi- 
nation; 

quantizing the input image based upon the results of 
discrimination, the input image and the corrected input 
image; 

combining results of quantization obtained in the quan- 
tizing steps; 

partitioning the input image into areas based upon the 
combined results of quantization; and 

coding each partitioned area in conformity with charac- 
teristics of the area, 

wherein the discriminating step comprises the steps of: 
smoothing the input image, 

extracting, from the smoothed input image, pixels 

forming a flat portion of the image, 
counting frequency of occurrence of the value of each 

extracted flat pixel, and 
detecting the state of the background of the input image 

from a distribution of frequencies obtained in the 

counting step. 
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